cxl: Fix possible idr warning when contexts are released

An idr warning is reported when a context is release after the capi card
is unbound from the cxl driver via sysfs. Below are the steps to
reproduce:

1. Create multiple afu contexts in an user-space application using libcxl.
2. Unbind capi card from cxl using command of form
   echo <capi-card-pci-addr> > /sys/bus/pci/drivers/cxl-pci/unbind
3. Exit/kill the application owning afu contexts.

After above steps a warning message is usually seen in the kernel logs
of the form "idr_remove called for id=<context-id> which is not
allocated."

This is caused by the function cxl_release_afu which destroys the
contexts_idr table. So when a context is release no entry for context pe
is found in the contexts_idr table and idr code prints this warning.

This patch fixes this issue by increasing & decreasing the ref-count on
the afu device when a context is initialized or when its freed
respectively. This prevents the afu from being released until all the
afu contexts have been released. The patch introduces two new functions
namely cxl_afu_get/put that manage the ref-count on the afu device.

Also the patch removes code inside cxl_dev_context_init that increases ref
on the afu device as its guaranteed to be alive during this function.

Reported-by: Ian Munsie <imunsie@au1.ibm.com>
Signed-off-by: Vaibhav Jain <vaibhav@linux.vnet.ibm.com>
Acked-by: Ian Munsie <imunsie@au1.ibm.com>
Signed-off-by: Michael Ellerman <mpe@ellerman.id.au>

1 files changed, 11 insertions, 8 deletions

diff --git a/drivers/misc/cxl/file.c b/drivers/misc/cxl/file.c
index 7ccd2998be92..5cc14599837d 100644
--- a/drivers/misc/cxl/file.c
+++ b/drivers/misc/cxl/file.c
@@ -67,7 +67,13 @@ static int __afu_open(struct inode *inode, struct file *file, bool master)
                 spin_unlock(&adapter->afu_list_lock);
                 goto err_put_adapter;
         }
-        get_device(&afu->dev);
+
+        /*
+         * taking a ref to the afu so that it doesn't go away
+         * for rest of the function. This ref is released before
+         * we return.
+         */
+        cxl_afu_get(afu);
         spin_unlock(&adapter->afu_list_lock);
 
         if (!afu->current_mode)
@@ -90,13 +96,12 @@ static int __afu_open(struct inode *inode, struct file *file, bool master)
         file->private_data = ctx;
         cxl_ctx_get();
 
-        /* Our ref on the AFU will now hold the adapter */
-        put_device(&adapter->dev);
-
-        return 0;
+        /* indicate success */
+        rc = 0;
 
 err_put_afu:
-        put_device(&afu->dev);
+        /* release the ref taken earlier */
+        cxl_afu_put(afu);
 err_put_adapter:
         put_device(&adapter->dev);
         return rc;
@@ -131,8 +136,6 @@ int afu_release(struct inode *inode, struct file *file)
                 mutex_unlock(&ctx->mapping_lock);
         }
 
-        put_device(&ctx->afu->dev);
-
         /*
          * At this this point all bottom halfs have finished and we should be
          * getting no more IRQs from the hardware for this context.  Once it's