From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 509A842FD0 for ; Fri, 4 Aug 2023 10:32:00 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 0632443256; Fri, 4 Aug 2023 10:31:57 +0200 (CEST) Received: from mail-pl1-f176.google.com (mail-pl1-f176.google.com [209.85.214.176]) by mails.dpdk.org (Postfix) with ESMTP id 524CD406B8 for ; Thu, 3 Aug 2023 07:40:33 +0200 (CEST) Received: by mail-pl1-f176.google.com with SMTP id d9443c01a7336-1bc3d94d40fso5207165ad.3 for ; Wed, 02 Aug 2023 22:40:33 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=meter.com; s=google; t=1691041232; x=1691646032; h=to:date:message-id:subject:mime-version:content-transfer-encoding :from:from:to:cc:subject:date:message-id:reply-to; bh=v5MY/usRhTaH6E/Flf3q4xUuXQ+T8B6MMPJnnfC9nuk=; b=FyqZgiaA+MVJmrgAws3vY8nw2iDBiT0+9Dfd5+7cqJ++Y2XLXpOLdc0h3VBVvLCdyv aUOjOmYEIQ7aGVK9ZpKEHPFd/4IMlyyfqariu58ogjadLjg5dpHMTkep1yi3JBugBVwE CmCGFUeXtcv8weKRe5bJuW1lPF7vG36tQvcxA= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1691041232; x=1691646032; h=to:date:message-id:subject:mime-version:content-transfer-encoding :from:x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=v5MY/usRhTaH6E/Flf3q4xUuXQ+T8B6MMPJnnfC9nuk=; b=kfVrhmim7Ne3ccky+RQhg5DQBxixz9GNvqhfezpPzVRJ8aS95BLb3X5cIOM+4gNpbY nDcKnSifULnlL4+IkH0TTvnJaRZrqYX+4hwG+BgSsYeNnxxgn1o+QS/SCWQZx7Snfuju HZoyMzi5J/hAIPbBNxq0eCeQYYFmXW8HWO6VoY5uOtmyLJg+lvfvZ9Z9TWbKhqyP/4g2 3IGJa3yT8RWRz7Ps5yocaOlcOj1kxPn8x7VivjBWKL3gQ+qFurRqid45rUeMxpEo5+RO bjKfvv/zZXXWtu5Ho4Cir1LvdBeeNSGLRmOVEIOGk/vP1nYuRoBrxvXe2Pp7wYil4WkB +/yQ== X-Gm-Message-State: ABy/qLaMr3Ce2oK7oJ8HCJAmTs4f6EKmx87x6SDdskBGvU1OO+vLv2z8 A6pxsyyg1wPKAm0l9Gi9oJAjqDXCXka/R0g97jRefw== X-Google-Smtp-Source: APBJJlEhpq/zjgKbl68xK0rt4cf028nDWV9TsS5HfWW/s7wEIi2YC/BejzJUAn2gJXv+8A2ukCZ/Wg== X-Received: by 2002:a17:903:228f:b0:1b9:be2e:2b40 with SMTP id b15-20020a170903228f00b001b9be2e2b40mr22090112plh.50.1691041232213; Wed, 02 Aug 2023 22:40:32 -0700 (PDT) Received: from smtpclient.apple ([136.25.84.103]) by smtp.gmail.com with ESMTPSA id b11-20020a170903228b00b001b895336435sm13355477plh.21.2023.08.02.22.40.31 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Wed, 02 Aug 2023 22:40:32 -0700 (PDT) From: Paul Ugolini Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: binding i226 NIC to dpdk causes link/activity led blinking with no link or activty Message-Id: <752FDB4D-1647-4DD5-B2B4-8B84B306B949@meter.com> Date: Wed, 2 Aug 2023 22:40:19 -0700 To: users@dpdk.org X-Mailer: Apple Mail (2.3731.700.6) X-Mailman-Approved-At: Fri, 04 Aug 2023 10:31:55 +0200 X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org Hi all, I'm noticing strange behavior when binding an i226-LM to dpdk: = the link/activity light will blink until the system is fully rebooted, = regardless of physical link state or if there is actually activity on = the link. Using dpdk 22.07.0 Steps to reproduce: 1. remove ethernet from nic 03:00.0 2. reboot 3. boot linux 6.1.12-intel-pk-standard (03:00.0 registers through igc) igc 0000:03:00.0: enabling device (0140 -> 0142) igc 0000:03:00.0: PCIe PTM not supported by PCIe bus/controller igc 0000:03:00.0 (unnamed net_device) (uninitialized): PHC added igc 0000:03:00.0: 4.000 Gb/s available PCIe bandwidth (5.0 GT/s = PCIe x1 link) igc 0000:03:00.0 eth0: MAC: XX:XX:XX:XX:XX:XX igc 0000:03:00.0 enp3s0: renamed from eth0 igc 0000:03:00.0 enp3s0: PHC removed 4. observe: link/activity led is off 5. bind 03:00.0 to dpdk: dpdk-devbind.py -s vfio-pci 03:00.0 6. observe: link/activity led is flashing with no link 7. attach ethernet cable, bring up dpdk link, pass traffic 8. observe: link/activity led blinks regardless of if traffic is passing = or not 9. stop dpdk app on 03:00.0 10. unbind 03:00.0 from dpdk, to igc: dpdk-devbind.py -s igc 03:00.0 igc 0000:03:00.0: PCIe PTM not supported by PCIe bus/controller pps pps0: new PPS source ptp0 igc 0000:03:00.0 (unnamed net_device) (uninitialized): PHC added igc 0000:03:00.0: 4.000 Gb/s available PCIe bandwidth (5.0 GT/s = PCIe x1 link) igc 0000:03:00.0 enp3s0: renamed from eth0 igc 0000:03:00.0 enp3s0: MAC: XX:XX:XX:XX:XX:XX 11. remove ethernet cable from 03:00.0 12. observe: link/activity led is still flashing, despite enp3s0 link = being fully down Resetting the nic with `echo 1 > = /sys/bus/pci/devices/0000\:03\:00.0/remove` or removing the nic with = `echo 1 > /sys/bus/pci/devices/0000\:03\:00.0/remove; sleep 1; echo 1 > = /sys/bus/pci/rescan` does not stop the blinking, but since a soft reboot = does This device has several igxbe nics as well, which don't exhibit this = behavior with dpdk. If I replace 03:00.0 with 08:00.0 the link/activity = led will behave as expected: light up with a link and only blink on = activity. ~# dpdk-devbind -s Network devices using DPDK-compatible driver =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D 0000:03:00.0 'Ethernet Controller I226-LM 125b' drv=3Dvfio-pci = unused=3Digc,uio_pci_generic ... 0000:08:00.0 'Ethernet Connection X553 1GbE 15e4' drv=3Dvfio-pci = unused=3Duio_pci_generic ~# lspci -nn ... 03:00.0 Ethernet controller [0200]: Intel Corporation Ethernet = Controller I226-LM [8086:125b] (rev 04) ... 08:00.0 Ethernet controller [0200]: Intel Corporation Ethernet = Connection X553 1GbE [8086:15e4] (rev 11) ... Thanks, Paul=