From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 4760FA0C4D; Fri, 15 Oct 2021 22:11:36 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 0F6A2410F2; Fri, 15 Oct 2021 22:11:36 +0200 (CEST) Received: from mail-pj1-f51.google.com (mail-pj1-f51.google.com [209.85.216.51]) by mails.dpdk.org (Postfix) with ESMTP id 579BF4003C for ; Fri, 15 Oct 2021 22:11:34 +0200 (CEST) Received: by mail-pj1-f51.google.com with SMTP id om14so7953208pjb.5 for ; Fri, 15 Oct 2021 13:11:34 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=networkplumber-org.20210112.gappssmtp.com; s=20210112; h=from:to:cc:subject:date:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=1X5ohHJBMCHIlG5cVDDN7ucwJ245V/BKGsnLyTIPx6M=; b=ec0mhNwlHKqh5wCsBI7h+WT3x75fqILAo0oHpOOkE+l5tfur0yllJSW1RZX8o/zX7J sLBlfqZyGGtD5KMQLSvqXffgOkf2L4K60cNpJHBW0436kl7fi6UGx28BwHXZcLY8PDdv kzuPUCgejKQ442ruADbunEKCiMBBqI0unkVHD1wuH9HuHzmVp1HFy473YsZ1E6jeXMB+ 3yTsNvQaFUDH73wa6H+SCcS7xmEfxslZrWRm4OQ+2EUP1HV001pJ4xMlAgmUQT2kbZLI Yx+wXMVFdh+4R6o3wVVjhK+V5H0TQtSkFgJfmjstx0xRZBfnYcF9hsLXn5e7YBRIolJ3 SpCQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=1X5ohHJBMCHIlG5cVDDN7ucwJ245V/BKGsnLyTIPx6M=; b=dIgUuwwx9hepJaykqhssy0kymSJmq2fWkuAjZyk4jGxvXllPWAKdMzHjR97AI7nXx1 tebkRPzeym3omxepcFOqV9Y2QRUkvElhF6bsbuWlNtH39g4z6KwPciSyod69XaaSCs52 uFeA7+fsJ9O7bj3Cv7DtW+JDDTsjUd5vlHQceX6IOmCCswky9VKaMlqgMVhOEJzPeLSF RF1y4blyfegawCDYSvzmFUnS4zjvmAD4fyOFp9B7uJbepJFGqZtLbydEENewGRsETPAC vkoj8lW8mIsmpKNvpzxJyfK/vfCR6uoQIXzIYCoaLJx6GULZ9WIV1AzAbvL4DuIeNZzL iChA== X-Gm-Message-State: AOAM531rywHOmnfv+/jJpLe3QDcJKS5A41m0bvZO9I4iXlK0eMsm+49A VMNKdH/Y8u2ouhaXoC6Wz9aTQh7pYA4= X-Google-Smtp-Source: ABdhPJzDM6awdBCkSsvaLtXTqiRASU0O4eEMgixwkqWrkjl0C9jzXfJHz7z00Na4QNd5i23YjJSmFw== X-Received: by 2002:a17:90a:7bc8:: with SMTP id d8mr29666773pjl.128.1634328692740; Fri, 15 Oct 2021 13:11:32 -0700 (PDT) Received: from hermes.local (204-195-33-123.wavecable.com. [204.195.33.123]) by smtp.gmail.com with ESMTPSA id g4sm5250456pgs.42.2021.10.15.13.11.31 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 15 Oct 2021 13:11:31 -0700 (PDT) From: Stephen Hemminger To: dev@dpdk.org Cc: Stephen Hemminger Date: Fri, 15 Oct 2021 13:11:17 -0700 Message-Id: <20211015201129.63220-1-stephen@networkplumber.org> X-Mailer: git-send-email 2.30.2 In-Reply-To: <20210903004732.109023-1-stephen@networkplumber.org> References: <20210903004732.109023-1-stephen@networkplumber.org> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Subject: [dpdk-dev] [PATCH v14 00/12] Packet capture framework update X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" This patch set is a more complete version of the the enhanced packet capture support described last year. The new capture library and utility are: - faster avoids lots of extra I/O, does bursting, etc. - gives more information (multiple ports, queues, etc) - has a better user interface (same as Wireshark dumpcap) - fixes structural problems with VLAN's and timestamps There are no blocker items. The following are worth noting: * bogus checkpatch warnings - the correct flag to open is O_CREAT - intentionally keeping macro with goto since that was in original code and is clearer - the tempfile name can not be const since it is overwritten by tmpfile() call * enabling BPF tests causes CI to see a pre-existing bug https://bugs.dpdk.org/show_bug.cgi?id=811 * future filtering for stripped VLAN tags needs collabration with libpcap project to fix pcap_compile_filter(). v14 - fix checkpatch whitespace warning - enhance the pcapng prog guide documentation v13 - integrate feedback in documentation and pcapng library - rebase to align with rte_ether_addr changes v12 - fixes for capture offloaded VLAN tags. look at direction flag and handle QinQ offload. v11 - address review comments for pdump (patch 6) v10: - fix to rte_bpf_dump to handle more instructions make sure all bpf_test cases are decoded v9: - incorporate suggested change to BPF XOR - make autotest for pcapng more complete by reading the resulting file with libpcap v8: - enable BPF tests in autotest - add more BPF test strings - use rte_strscpy to satisfy checkpatch - merge MAINTAINERS (put this in with existing pdump) v7: - add functional tests for pcapng lib - bug fix for error returns in pcapng lib - handle long osname on FreeBSD - resolve almost all checkpatch issues v5: - minor build and checkpatch fixes for RHEL/FreeBSD - disable lib/pdump on Windows. It was not useful before and now pdump depends on bpf. v4: - minor checkpatch fixes. Note: some of the checkpatch warnings are bogus and won't be fixed. - fix build of dumpcap on FreeBSD v3: - introduce packet filters using classic BPF to eBPF converter required small fix to DPDK BPF interpreter - introduce function to decode eBPF instructions - add option to dumpcap to show both classic BPF and eBPF result - drop some un-useful stubs - minor checkpatch warning cleanup v2: fix formatting of packet blocks fix the new packet capture statistics fix crash when primary process exits record start/end time various whitespace/checkpatch warnings Stephen Hemminger (12): lib: pdump is not supported on Windows librte_pcapng: add new library for writing pcapng files bpf: allow self-xor operation bpf: add function to convert classic BPF to DPDK BPF bpf: add function to dump eBPF instructions pdump: support pcapng and filtering app/dumpcap: add new packet capture application test: add test for bpf_convert test: add a test for pcapng library test: enable bpf autotest doc: changes for new pcapng and dumpcap utility MAINTAINERS: add entry for new packet capture features MAINTAINERS | 11 +- app/dumpcap/main.c | 844 ++++++++++++++++++ app/dumpcap/meson.build | 16 + app/meson.build | 1 + app/test/meson.build | 6 + app/test/test_bpf.c | 200 +++++ app/test/test_pcapng.c | 272 ++++++ doc/api/doxy-api-index.md | 1 + doc/api/doxy-api.conf.in | 1 + .../howto/img/packet_capture_framework.svg | 96 +- doc/guides/howto/packet_capture_framework.rst | 69 +- doc/guides/prog_guide/index.rst | 1 + doc/guides/prog_guide/pcapng_lib.rst | 46 + doc/guides/prog_guide/pdump_lib.rst | 28 +- doc/guides/rel_notes/release_21_11.rst | 10 + doc/guides/tools/dumpcap.rst | 86 ++ doc/guides/tools/index.rst | 1 + lib/bpf/bpf_convert.c | 575 ++++++++++++ lib/bpf/bpf_dump.c | 139 +++ lib/bpf/bpf_validate.c | 9 +- lib/bpf/meson.build | 6 + lib/bpf/rte_bpf.h | 39 + lib/bpf/version.map | 7 + lib/meson.build | 6 +- lib/pcapng/meson.build | 8 + lib/pcapng/pcapng_proto.h | 129 +++ lib/pcapng/rte_pcapng.c | 607 +++++++++++++ lib/pcapng/rte_pcapng.h | 195 ++++ lib/pcapng/version.map | 12 + lib/pdump/meson.build | 2 +- lib/pdump/rte_pdump.c | 432 ++++++--- lib/pdump/rte_pdump.h | 113 ++- lib/pdump/version.map | 8 + 33 files changed, 3757 insertions(+), 219 deletions(-) create mode 100644 app/dumpcap/main.c create mode 100644 app/dumpcap/meson.build create mode 100644 app/test/test_pcapng.c create mode 100644 doc/guides/prog_guide/pcapng_lib.rst create mode 100644 doc/guides/tools/dumpcap.rst create mode 100644 lib/bpf/bpf_convert.c create mode 100644 lib/bpf/bpf_dump.c create mode 100644 lib/pcapng/meson.build create mode 100644 lib/pcapng/pcapng_proto.h create mode 100644 lib/pcapng/rte_pcapng.c create mode 100644 lib/pcapng/rte_pcapng.h create mode 100644 lib/pcapng/version.map -- 2.30.2