From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id 66BA9A04F5; Thu, 12 Dec 2019 21:29:36 +0100 (CET) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id 71AE41BF83; Thu, 12 Dec 2019 21:29:35 +0100 (CET) Received: from us-smtp-delivery-1.mimecast.com (us-smtp-2.mimecast.com [207.211.31.81]) by dpdk.org (Postfix) with ESMTP id 0D5601BF80 for ; Thu, 12 Dec 2019 21:29:32 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1576182571; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:autocrypt:autocrypt; bh=ScGV+HqZzKo6sBfc1Sz6J9vDkH5RDxWk5HUu6/TK2V4=; b=XJ5Sxeo/W3x/WbWQGC3ELve/UzUejZKmpayKc8zX7Sh0uYeDxAhFf3dx0vurNwG6v5GjjX 50JGp8IRpkJ2KvPENyLSh4CJvSb52ubqeWFDuH+z9F2+z4hgJalgzVJY3NP5hU5GpKTCwr mNc6tKSYtWBX/9a+H8VyT5AKSkAoyew= Received: from mimecast-mx01.redhat.com (mimecast-mx01.redhat.com [209.132.183.4]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-273-NBbjlLe9NHqoe6xAT4ZePA-1; Thu, 12 Dec 2019 15:29:27 -0500 Received: from smtp.corp.redhat.com (int-mx03.intmail.prod.int.phx2.redhat.com [10.5.11.13]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mimecast-mx01.redhat.com (Postfix) with ESMTPS id DA3CB1005502; Thu, 12 Dec 2019 20:29:25 +0000 (UTC) Received: from [10.36.117.53] (ovpn-117-53.ams2.redhat.com [10.36.117.53]) by smtp.corp.redhat.com (Postfix) with ESMTP id B6E8B6767E; Thu, 12 Dec 2019 20:29:24 +0000 (UTC) To: Ajit Khaparde , Christophe Grosse Cc: dpdk-dev References: From: Kevin Traynor Autocrypt: addr=ktraynor@redhat.com; keydata= mQINBF2J2awBEADUEPNhgNI+nJNgiTAUcw4YIgVXEoHlsNPyyzG1BEXkWXALy0Y3fNTiw6+r ltWDkF9jzL9kfkecgQ67itGfk1OaBXgSGKuw1PUpxAwX2Bi76LAR6M5OsyGM9TSVVQwARalz hMwRBIZPzPc7or6Pw7jAOJ8SQGJ1Zlp1YJCjrvpe87V1tH/LY8Wnxn/EuoseFmWILAQZAtYS tGjcrAgYn3SPMLR1B0BP5bTBY06vWQjiufH8drenfDnMJAzuBdG1mqjnTqCjULZ3Hunv4xqZ aMnkvL/K5Tj1c12Oe4930EE53LrXIBUltRg5mBudSWHnC7twjH0082HH9f963Z/2UI63SFIT iUvRvAzJYytgy7XnWLQ0+goZBADKYfolOuC0H8VgCaux8u8KFF28Dy+N6TV2KI58jTlyg1Zu l7QwykZpnOkJFiy37Gfbu3YEOzO72cP/S7/A+zvuqkxi63jyEkd+FY99vLt/HN2MUZwRmKDw UPbLkmrs8WU01/POVsqDcfvz7vu2St8hqqTiSIdQGS2zyTKB2/DvPSM3jws3udkIYSuhn+X4 QBiV6lkVZ7DSE6a065gnAauAql+b32Eymy+xnG5jCt1tR+0Cp2VZYCR9OU2gmomUKBDoX/He pSgED01CqYPNjN+TddirwmQX7ep4DtXc8FWvv2g/pq9WZFQk2QARAQABtCNLZXZpbiBUcmF5 bm9yIDxrdHJheW5vckByZWRoYXQuY29tPokCTgQTAQgAOBYhBAoiOaH51tHF7VYtEI9CINER a+yJBQJdidmsAhsDBQsJCAcCBhUKCQgLAgQWAgMBAh4BAheAAAoJEI9CINERa+yJoxIP/3VF 2TIgW4ckxhRFCvFu/606bnvCPie88ake4uWVWMAWwcMc4fKEltRWRCpkSVOwgqoMHnyHxK5r kOKzx2CLJMX5TgTMfKzPuaBDHngHLUzl2DStpBzrod0cVg5TShdmmfjY61uxRJKz+DlSkwgJ riADdVF5PPosQXTkKSGf2ombpTGpx/pue9ocjnr3x4SDpRLlnooM6Jf/3Y3Ib4jX6HPEyWuY b+owIIk9y2nRRGPQ6jbqAhsrXd9V+77UL0QuGWloMuKMZFbNg8hbu7X5aFijAbfxj4YUgojS ba7gfGZQan8h32A9KGQWrmsCBc3j2GqEPsX0r05X7cn7WL6IOPgQJ5EiQ7PlazQYVLrvZg9B n0GKK0k6895mLG0ZZ5v/qajOPF52etSmvFD1WUPb4OqaHqGA9ZtMpaKFRt7Y6rpXqKNU1xzW F5KjbTPtTb9WF3An8dciVv+AYUI7totkZYkWvQtgss8lfaX3NKUvXLVxqK0z3dQyr7rF/tYz PneTKypSksjCgaEBLSrsRmM5zKfe7tSNF/fDntfIq/029Jtcw29TcWEP57peNu6TtejewQD9 sTI+oqiXvW2D5l7LNUDYG8eMJp2oT7I0ZSBRvwcbmjH0DtN/bXCCFfCvk8Yic68F3tV1ctix wQARVKDBhT30uCxycRWojCYqTgNJJS71uQINBF2J2awBEADP57PR2IpSYBeNSrsAjeIcsahE N4SQP2C4s50S8QEWAUhqMRI7WNv5cfeef0nDvcl1IUA6oz5SokbcsbMa+mRgaNF4N5KikWTO LPYxq2YVJoXwJ+tKmNzyOLFUIfFJ4NBJZple5dTfWzD00Dbb19Mri1hy1mWMqNTPGBee1+hw Qcp6n3mmGECvajs8G5A7NyXbwL8ihN7HX9D01ucD62b4G03yKe2g/hvKgcdUVmhCldJlF27I 2fSR9tDxH9pZqRODY4rjbFZEey/vWKXqjE+DQ8AtMSEaDfFe5D+i4Aw6erWQ3Wr+DwZt1/7G dIAElGA/q90T1ENVwJX9y7fsQssawKYYdDqURHCl5JuDXI+VXUypExipUUT5SPycMmbLsx0D iKEqPPDQWKxkIDVKqj2+EhamSuJznZUwBLJKn0h4zrIWiXWUy07lRwtVuhaDXhF3GfW+5W/x wAg7Qg3w00ASsb/XTHBIhMnenKDfS7ihtQA8SacwX8ySdxb+15XPyiplM979qBQ0mhnilulm MIJzEf/JxoYR5huuj4f1PFqqrsP06Dl+YGB7dQZp3IKggS5c3/TAynARRg9N89UsDXNtp7X0 tgIPFF5k6fnHE0J5O64GYHeTqN/1aE6dAEOV9WrGzQAJxU9ipikb8jKAWXzLewRIKGmoPcRZ WdB0NmIjmQARAQABiQI2BBgBCAAgFiEECiI5ofnW0cXtVi0Qj0Ig0RFr7IkFAl2J2awCGwwA CgkQj0Ig0RFr7IkkORAAl/NbX93WK5MEoRw7/DaPTo/Lo6Pj1XMeSqGyACigHK/452UDvlEH NjNJMzYYrNIjMtEmN9VVCfjT38CSca7mpGQVwchc0mC7QSPAETLCS+UacVf/Kwxz5FfkEUUw UT7A+uyVOIgW3d9ldlRzkHA2czonSSgTQU+i2g6DM4ha+BuQb4byAXH6HQHt/Zh1J64z0ohH v6iGsCzCY/sMWF8+LEGSnzMGRCLiiwSF0vJBHbzWK68fANaF4gBV0Z/+6tQRFN7YMhj/INmk qgvHj1ZzHFNtirjMGPRxoZs51YoLQM/aBPxKrnmXThx1ufH+0L6sGmFTugiDt0XSEkC5reH7 a+VhQ1VTFFQrClA8NmDSPzFeuhru4ryaaDHO+uEB16cNHxHrQtlP/2hts2JM5lwkZRWJ5A57 h8eDEIK5be47T85NVHfuTaboNRmgg1HygVejhGUtt69u/0MVRg/roUTa0FyEbNsvz4qAecyW yWzMcVrcGJDQLC9JLKEpoyUF6gdTKaiDL2Vao4+XRIA3Y57b6MO35a3HuzAv7+i5Z0mnDEJO XxXqTOmKYpMIGexzM/PtuA0712sT1abG9tAJ17ao/B7cqMW5IkKkalemFbWfI2unns4Papvo tk9igVqyp6EJDU98z5TJioCVojwK2laDaoIjTJk9YYv3iwCsqPd5feU= Message-ID: <6862a2e3-8c02-f941-f05d-c74bf23bd447@redhat.com> Date: Thu, 12 Dec 2019 20:29:23 +0000 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.2.2 MIME-Version: 1.0 In-Reply-To: Content-Language: en-US X-Scanned-By: MIMEDefang 2.79 on 10.5.11.13 X-MC-Unique: NBbjlLe9NHqoe6xAT4ZePA-1 X-Mimecast-Spam-Score: 0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Subject: Re: [dpdk-dev] BCM57414 VF Mode: max_rx_em_flows value is inconsistent X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" Hi Christophe, On 11/12/2019 17:45, Ajit Khaparde wrote: > On Wed, Dec 11, 2019 at 7:57 AM Christophe Grosse < > christophe.grosse@6wind.com> wrote: >=20 >> Hello, >> >> I am using DPDK 18.11.5 from dpdk-stable repository with a Broadcom >> network adapter in VF mode : >> Broadcom Limited BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet >> Controller (rev 01) >> # ./bnxtnvm listdev >> Broadcom P225p NetXtreme-E Dual-port 10Gb/25Gb Ethernet PCIe Adapter #1 >> Device Interface Name : ntfp2 >> MACAddress : 00-0A-F7-B6-E3-D1 >> PCI Device Name : 0000:02:00.1 >> >> # ./bnxtnvm -dev=3Dntfp2 devid >> PCI VendorID : 14e4 >> PCI DeviceID : 16d7 >> PCI Subsys VendorID : 14e4 >> PCI Subsys DeviceID : 1402 >> PCI Device Name : 0000:02:00:1 >> >> # ./bnxtnvm -dev=3Dntfp2 pkgver >> Active Package version : 20.06.01.06 >> Package version on NVM : 20.06.01.06 >> >> I added a log inside function __bnxt_hwrm_func_qcaps() and I notice >> that max_rx_em_flows value is inconsistent. It changes right after >> port init. >> >> max_mac_addrs is also inconsistent because it depends on >> max_rx_em_flows since commit : >> >> http://scm.6wind.com/pub/dpdk.org/dpdk-stable/commit/?h=3D18.11&id=3D15f= 42f5e426d >> , >> >> This is the log I have, when I launch ethtool example application. >> For port 1, max_rx_em_flows=3D51116 and then max_rx_em_flows=3D61292 >> >> # ethtool -l 0-1 -n 4 >> EAL: Detected 12 lcore(s) >> EAL: Detected 1 NUMA nodes >> EAL: Multi-process socket /var/run/dpdk/rte/mp_socket >> EAL: Some devices want iova as va but pa will be used because.. EAL: >> vfio-noiommu mode configured >> EAL: No free hugepages reported in hugepages-1048576kB >> EAL: Probing VFIO support... >> EAL: VFIO support initialized >> EAL: WARNING: cpu flags constant_tsc=3Dyes nonstop_tsc=3Dno -> using >> unreliable clock cycles ! >> EAL: PCI device 0000:00:03.0 on NUMA socket -1 >> EAL: Invalid NUMA socket, default to 0 >> EAL: probe driver: 1af4:1000 net_virtio >> EAL: PCI device 0000:00:04.0 on NUMA socket -1 >> EAL: Invalid NUMA socket, default to 0 >> EAL: probe driver: 14e4:16dc net_bnxt >> EAL: using IOMMU type 8 (No-IOMMU) >> bnxt_dev_init(): Broadcom NetXtreme driver bnxt >> >> bnxt_hwrm_ver_get(): 1.7.6:20.6.107 >> bnxt_hwrm_ver_get(): Driver HWRM version: 1.9.2 >> __bnxt_hwrm_func_qcaps(): !!!!!!!!!!!! bp->max_l2_ctx=3D 4 + 51116 =3D 5= 1120 >> bnxt_dev_init(): bnxt found at mem feb04000, node addr 0x1100800000M >> EAL: PCI device 0000:00:05.0 on NUMA socket -1 >> EAL: Invalid NUMA socket, default to 0 >> EAL: probe driver: 14e4:16dc net_bnxt >> bnxt_hwrm_ver_get(): 1.7.6:20.6.107 >> bnxt_hwrm_ver_get(): Driver HWRM version: 1.9.2 >> __bnxt_hwrm_func_qcaps(): !!!!!!!!!!!! bp->max_l2_ctx=3D 4 + 51116 =3D 5= 1120 >> bnxt_dev_init(): bnxt found at mem feb0c000, node addr 0x1100908000M >> Number of NICs: 2 >> !!!!!!!!!!!! dev_info.max_mac_addrs=3D 51120 >> !!!!!!!!!!!! dev_info.max_mac_addrs=3D 51120 >> >> Init port 0.. >> __bnxt_hwrm_func_qcaps(): !!!!!!!!!!!! bp->max_l2_ctx=3D 4 + 1 =3D 5 >> !!!!!!!!!!!! dev_info.max_mac_addrs=3D 5 >> bnxt_print_link_info(): Port 0 Link Down >> bnxt_print_link_info(): Port 0 Link Up - speed 10000 Mbps - full-duplex >> >> Init port 1.. >> __bnxt_hwrm_func_qcaps(): !!!!!!!!!!!! bp->max_l2_ctx=3D 4 + 61292 =3D 6= 1296 >> !!!!!!!!!!!! dev_info.max_mac_addrs=3D 61296 >> bnxt_print_link_info(): Port 1 Link Down >> bnxt_print_link_info(): Port 1 Link Up - speed 10000 Mbps - full-duplex >> EthApp> >> >> On master, I see that the new calculation for the number of L2 context >> has been restricted to Whitney chip family. >> Anyone knows if the chip/FW I am using is compatible with this new >> calculation ? >> >> By the way, I tried to upgrade to FW 214.0.253.5 and Init is falling ver= y >> early: >> bnxt_hwrm_func_resc_qcaps(): error 1:0:00000000:00f9 >> > 214.0.x is older FW as far our releases are concerned. > I think you will need the following commit from upstream > to get past the error you are seeing. > Commit: 89a0deb866dc42ead92b79e6e7159622e1ab8490 > net/bnxt: fix resource qcaps with older FW >=20 This commit is queued [0] for 18.11.6, I will push to dpdk.org next week provided no objections [1]. Please note there are many bnxt fixes which are not currently applied/queued for 18.11 [2] at this time due to divergence of the code on master. If there are some you think you need, it is good to talk with the author/maintainer - or send a backport :-) thanks, Kevin. [0] https://github.com/kevintraynor/dpdk-stable-queue/commit/65bcaa3d86eb230bb9= b9f53762db52d5e847d00b [1] https://mails.dpdk.org/archives/stable/2019-December/019030.html [2] https://mails.dpdk.org/archives/stable/2019-December/019067.html > But I believe you will need a newer firmware to get consistent values > across the ports. Let me see how to get that to you. >=20 > Thanks > Ajit >=20 >=20 >> bnxt_dev_init(): hwrm query capability failure rc: ffffffea >> EAL: Requested device 0000:00:04.0 cannot be used >> >> >> Best Regards >> Chris >> >=20