From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id 346EEA0556; Thu, 20 Feb 2020 20:24:56 +0100 (CET) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id 82CB44C81; Thu, 20 Feb 2020 20:24:55 +0100 (CET) Received: from mx0a-001b2d01.pphosted.com (mx0b-001b2d01.pphosted.com [148.163.158.5]) by dpdk.org (Postfix) with ESMTP id 12E4823D for ; Thu, 20 Feb 2020 20:24:53 +0100 (CET) Received: from pps.filterd (m0098417.ppops.net [127.0.0.1]) by mx0a-001b2d01.pphosted.com (8.16.0.42/8.16.0.42) with SMTP id 01KJOqB4023843 for ; Thu, 20 Feb 2020 14:24:53 -0500 Received: from ppma01dal.us.ibm.com (83.d6.3fa9.ip4.static.sl-reverse.com [169.63.214.131]) by mx0a-001b2d01.pphosted.com with ESMTP id 2y8ubq5qb0-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Thu, 20 Feb 2020 14:24:52 -0500 Received: from pps.filterd (ppma01dal.us.ibm.com [127.0.0.1]) by ppma01dal.us.ibm.com (8.16.0.27/8.16.0.27) with SMTP id 01KJLlpj017191 for ; Thu, 20 Feb 2020 19:24:37 GMT Received: from b01cxnp23033.gho.pok.ibm.com (b01cxnp23033.gho.pok.ibm.com [9.57.198.28]) by ppma01dal.us.ibm.com with ESMTP id 2y6897b18h-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Thu, 20 Feb 2020 19:24:37 +0000 Received: from b01ledav004.gho.pok.ibm.com (b01ledav004.gho.pok.ibm.com [9.57.199.109]) by b01cxnp23033.gho.pok.ibm.com (8.14.9/8.14.9/NCO v10.0) with ESMTP id 01KJOaWA50266370 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK) for ; Thu, 20 Feb 2020 19:24:36 GMT Received: from b01ledav004.gho.pok.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id B05AA112064 for ; Thu, 20 Feb 2020 19:24:36 +0000 (GMT) Received: from b01ledav004.gho.pok.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id 7E0F8112061 for ; Thu, 20 Feb 2020 19:24:36 +0000 (GMT) Received: from davids-mbp.usor.ibm.com (unknown [9.70.84.164]) by b01ledav004.gho.pok.ibm.com (Postfix) with ESMTP for ; Thu, 20 Feb 2020 19:24:36 +0000 (GMT) To: "dev@dpdk.org" From: David Christensen Message-ID: <1e44afa0-951c-9161-75d9-a1f679a1995e@linux.vnet.ibm.com> Date: Thu, 20 Feb 2020 11:24:35 -0800 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Thunderbird/68.4.2 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-TM-AS-GCONF: 00 X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.138, 18.0.572 definitions=2020-02-20_16:2020-02-19, 2020-02-20 signatures=0 X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 adultscore=0 clxscore=1015 priorityscore=1501 suspectscore=0 spamscore=0 bulkscore=0 impostorscore=0 mlxlogscore=999 lowpriorityscore=0 malwarescore=0 phishscore=0 mlxscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2001150001 definitions=main-2002200140 Subject: [dpdk-dev] Permissions Required to Run DPDK/MLX5 as Non-Root User? X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" Running DPDK 20.02-rc3 and attempting to use the MLX5 PMD as a non-root user. When starting testpmd I'm receiving the following error on both Power and x86_64 platforms (full output further down): net_mlx5: probe of PCI device 0000:01:00.0 aborted after encountering an error: Operation not supported Walking through the code (mlx5_pci_probe, mlx5_dev_spawn, mlx5_hrxq_drop_new, mlx5_glue_create_qp_ex) I see the call to ibv_create_qp_ex() is failing. Why might this be a problem for a non-root user? I verified that RDMA works correctly on the RHEL 8.1 platform with rping/udaddy as a non-root user. Dave $ ~/src/dpdk/build/app/dpdk-testpmd --log-level='pmd.net.mlx5:8' -w 0000:01:00.0 -w 0000:01:00.1 -l 4,8-63 -n 4 -- --rxq=16 --rxd=4096 --txq=16 --txd=1024 --nb-cores=32 -i -a --numa --forward-mode=macswap EAL: Detected 128 lcore(s) EAL: Detected 2 NUMA nodes EAL: Multi-process socket /run/user/1003/dpdk/rte/mp_socket EAL: Selected IOVA mode 'VA' EAL: 2048 hugepages of size 2097152 reserved, but no mounted hugetlbfs found for that size EAL: Probing VFIO support... EAL: VFIO support initialized EAL: PCI device 0000:01:00.0 on NUMA socket 0 EAL: probe driver: 15b3:1019 net_mlx5 net_mlx5: checking device "mlx5_1" net_mlx5: checking device "mlx5_3" net_mlx5: checking device "mlx5_0" net_mlx5: PCI information matches for device "mlx5_0" net_mlx5: checking device "mlx5_2" net_mlx5: no E-Switch support detected net_mlx5: naming Ethernet device "0000:01:00.0" net_mlx5: DevX is NOT supported net_mlx5: enhanced MPW is supported net_mlx5: SWP support: 7 net_mlx5: min_single_stride_log_num_of_bytes: 6 net_mlx5: max_single_stride_log_num_of_bytes: 13 net_mlx5: min_single_wqe_log_num_of_strides: 9 net_mlx5: max_single_wqe_log_num_of_strides: 16 net_mlx5: supported_qpts: 256 net_mlx5: device supports Multi-Packet RQ net_mlx5: tunnel offloading is supported net_mlx5: MPLS over GRE/UDP tunnel offloading is not supported net_mlx5: checksum offloading is supported net_mlx5: DV flow is not supported net_mlx5: maximum Rx indirection table size is 512 net_mlx5: VLAN stripping is supported net_mlx5: FCS stripping configuration is supported net_mlx5: enhanced MPS is enabled net_mlx5: port 0 MAC address is ec:0d:9a:ca:b2:b4 net_mlx5: port 0 MTU is 9238 net_mlx5: port 0 forcing Ethernet interface up net_mlx5: min tx inline configured: 0 net_mlx5: probe of PCI device 0000:01:00.0 aborted after encountering an error: Operation not supported EAL: Requested device 0000:01:00.0 cannot be used