From: Yasufumi Ogawa <ogawa.yasufumi@lab.ntt.co.jp>
To: x-fn-spp@sl.ntt-tx.co.jp, spp@dpdk.org
Subject: Re: [spp] [PATCH 01/30] doc: add setup guide
Date: Fri, 19 Jan 2018 09:52:19 +0900 [thread overview]
Message-ID: <02b1f8d7-bbab-49db-acd8-941993b43827@lab.ntt.co.jp> (raw)
In-Reply-To: <201801160516.w0G5GfWD009090@imss03.silk.ntt-tx.co.jp>
On 2018/01/16 14:16, x-fn-spp@sl.ntt-tx.co.jp wrote:
> From: Hiroyuki Nakamura <nakamura.hioryuki@po.ntt-tx.co.jp>
>
> Hi all,
>
>> Series applied, thanks.
>
> Ferruh, thank you for accepting our patches.
>
> We will post the document patches for spp_vf on DPDK17.08 in the
> following emails.
>
>
> Translate Japanese setup guide to English.
>
> Signed-off-by: Naoki Takada <takada.naoki@lab.ntt.co.jp>
I tried to apply your patches but failed because of an error in 8th
patch as following. Could you fix it? Thanks.
Applying: doc: modify figure in spp_vf_overview
error: patch failed: docs/spp_vf/spp_vf_overview.svg:215
error: docs/spp_vf/spp_vf_overview.svg: patch does not apply
Patch failed at 0008 doc: modify figure in spp_vf_overview
Yasufumi
> ---
> docs/spp_vf/setup.md | 288 +++++++++++++++++++++++++++++++++++++++++++++++++++
> 1 file changed, 288 insertions(+)
> create mode 100644 docs/spp_vf/setup.md
>
> diff --git a/docs/spp_vf/setup.md b/docs/spp_vf/setup.md
> new file mode 100644
> index 0000000..572777b
> --- /dev/null
> +++ b/docs/spp_vf/setup.md
> @@ -0,0 +1,288 @@
> +# Setup Guide
> +
> +## Environment
> +
> +* Ubuntu 16.04
> +* qemu-kvm
> +* DPDK v17.05
> +
> +## Setting
> +
> +### Host
> +
> +#### Edit Config
> +
> +Uncomment user and group in `/etc/libvirt/qemu.conf`.
> +
> +```sh
> +# /etc/libvirt/qemu.conf
> +
> +user = "root"
> +group = "root"
> +```
> +
> +Change `KVM_HUGEPAGES` from 0 to 1 in `/etc/default/qemu-kvm`.
> +
> +```sh
> +# /etc/default/qemu-kvm
> +
> +KVM_HUGEPAGES=1
> +```
> +
> +Change grub config for hugepages and isolcpus.
> +
> +```sh
> +# /etc/default/grub
> +
> +GRUB_CMDLINE_LINUX_DEFAULT="isolcpus=2,4,6,8,10,12-18,20,22,24,26-42,44,46 hugepagesz=1G hugepages=36 default_hugepagesz=1G"
> +```
> +
> +You need to run `update-grub` and reboot to activate grub config.
> +
> +```sh
> +$ sudo upadte-grub
> +$ sudo reboot
> +```
> +
> +You can check hugepage settings as following.
> +
> +```sh
> +$ cat /proc/meminfo | grep -i huge
> +AnonHugePages: 2048 kB
> +HugePages_Total: 36 # /etc/default/grub
> +HugePages_Free: 36
> +HugePages_Rsvd: 0
> +HugePages_Surp: 0
> +Hugepagesize: 1048576 kB # /etc/default/grub
> +
> +$ mount | grep -i huge
> +cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb,release_agent=/run/cgmanager/agents/cgm-release-agent.hugetlb,nsroot=/)
> +hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime)
> +hugetlbfs-kvm on /run/hugepages/kvm type hugetlbfs (rw,relatime,mode=775,gid=117)
> +hugetlb on /run/lxcfs/controllers/hugetlb type cgroup (rw,relatime,hugetlb,release_agent=/run/cgmanager/agents/cgm-release-agent.hugetlb,nsroot=/)
> +```
> +
> +Finally, you unmount default hugepage.
> +
> +```sh
> +$ sudo unmount /dev/hugepages
> +```
> +
> +#### Install jasson
> +
> +Network configuration is defined in JSON and `spp_vf` reads config from
> +the file while launching.
> +[jasson](http://www.digip.org/jansson/) is a JSON library written in C.
> +
> +It is required to use `json_path` feature of `jasson` for `spp_vf`.
> +It has develped under `json_path` branch and you need to checkout and compile
> +it manually.
> +
> +```sh
> +$ git clone https://github.com/rogerz/jansson
> +$ cd jansson
> +$ sudo git checkout json_path
> +Branch json_path set up to track remote branch json_path from origin. Switched to a new branch 'json_path'
> +```
> +
> +This setup guide expects that `jasson` is placed as `/opt/jasson`.
> +
> +```sh
> +$ sudo mkdir -p /opt/jansson
> +$ sudo mv jansson /opt/jansson
> +```
> +
> +Compile it as following.
> +
> +```sh
> +$ cd /opt/jansson/jansson
> +$ sudo autoreconf -i
> +$ sudo ./configure
> +$ sudo make
> +$ sudo make install
> +$ sudo ldconfig
> +```
> +
> +Then, confirm that header files of jasson are generated in `/usr/local/include`.
> +
> +```sh
> +$ ls -al /usr/local/include
> +total 24
> +drwxr-xr-x 2 root root 4096 Jul 28 16:45 .
> +drwxr-xr-x 10 root root 4096 May 27 10:23 ..
> +-rw-r--r-- 1 root root 1183 Jul 28 16:45 jansson_config.h
> +-rw-r--r-- 1 root root 9499 Jul 28 16:45 jansson.h
> +```
> +
> +#### Install DPDK
> +
> +Install DPDK v17.05 in any directory. This is a simple instruction and please refer
> +[Getting Started Guide for Linux](http://dpdk.org/doc/guides/linux_gsg/index.html)
> +for details.
> +
> +```sh
> +$ cd /path/to/any_dir
> +$ git clone http://dpdk.org/git/dpdk
> +$ cd dpdk
> +$ git checkout v17.05
> +$ export RTE_SDK=`pwd`
> +$ export RTE_TARGET=x86_64-native-linuxapp-gcc
> +$ make T=x86_64-native-linuxapp-gcc install
> +```
> +
> +#### Install SPP
> +
> +Clone SPP in any directory and compile it.
> +
> +```sh
> +$ cd /path/to/spp_home/
> +$ git clone https://github.com/ntt-ns/Soft-Patch-Panel.git
> +export SPP_HOME=/path/to/spp_home/Soft-Patch-Panel
> +$ cd $SPP_HOME
> +$ make
> +```
> +
> +#### Setup for DPDK
> +
> +Load igb_uio module.
> +
> +```sh
> +$ sudo modprobe uio
> +$ sudo insmod $RTE_SDK/x86_64-native-linuxapp-gcc/kmod/igb_uio.ko
> +$ lsmod | grep uio
> +igb_uio 16384 0 # igb_uio is loaded
> +uio 20480 1 igb_uio
> +```
> +
> +Then, bind it with PCI_Number.
> +```sh
> +$ $RTE_SDK/usertools/dpdk-devbind.py --status
> +# check your device for PCI_Number
> +
> +$ sudo $RTE_SDK/usertools/dpdk-devbind.py --bind=igb_uio [PCI_Number]
> +```
> +
> +#### virsh setup
> +
> +Edit VM configuration with virsh.
> +
> +```sh
> +$ virsh edit [VM_NAME]
> +<domain type='kvm' xmlns:qemu='http://libvirt.org/schemas/domain/qemu/1.0'>
> + <name>spp-vm1</name>
> + <uuid>d90f5420-861a-4479-8559-62d7a1545cb9</uuid>
> + <memory unit='KiB'>4194304</memory>
> + <currentMemory unit='KiB'>4194304</currentMemory>
> + <memoryBacking>
> + <hugepages/>
> + </memoryBacking>
> + <vcpu placement='static'>4</vcpu>
> + <os>
> + <type arch='x86_64' machine='pc-i440fx-2.3'>hvm</type>
> + <boot dev='hd'/>
> + </os>
> + <features>
> + <acpi/>
> + <apic/>
> + <pae/>
> + </features>
> + <clock offset='utc'/>
> + <on_poweroff>destroy</on_poweroff>
> + <on_reboot>restart</on_reboot>
> + <on_crash>restart</on_crash>
> + <devices>
> + <emulator>/usr/local/bin/qemu-system-x86_64</emulator>
> + <disk type='file' device='disk'>
> + <driver name='qemu' type='raw'/>
> + <source file='/var/lib/libvirt/images/spp-vm1.qcow2'/>
> + <target dev='hda' bus='ide'/>
> + <address type='drive' controller='0' bus='0' target='0' unit='0'/>
> + </disk>
> + <disk type='block' device='cdrom'>
> + <driver name='qemu' type='raw'/>
> + <target dev='hdc' bus='ide'/>
> + <readonly/>
> + <address type='drive' controller='0' bus='1' target='0' unit='0'/>
> + </disk>
> + <controller type='usb' index='0'>
> + <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x2'/>
> + </controller>
> + <controller type='pci' index='0' model='pci-root'/>
> + <controller type='ide' index='0'>
> + <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
> + </controller>
> + <interface type='network'>
> + <mac address='52:54:00:99:aa:7f'/>
> + <source network='default'/>
> + <model type='rtl8139'/>
> + <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
> + </interface>
> + <serial type='pty'>
> + <target type='isa-serial' port='0'/>
> + </serial>
> + <console type='pty'>
> + <target type='serial' port='0'/>
> + </console>
> + <memballoon model='virtio'>
> + <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
> + </memballoon>
> + </devices>
> + <qemu:commandline>
> + <qemu:arg value='-cpu'/>
> + <qemu:arg value='host'/>
> + <qemu:arg value='-object'/>
> + <qemu:arg value='memory-backend-file,id=mem,size=4096M,mem-path=/run/hugepages/kvm,share=on'/>
> + <qemu:arg value='-numa'/>
> + <qemu:arg value='node,memdev=mem'/>
> + <qemu:arg value='-mem-prealloc'/>
> + <qemu:arg value='-chardev'/>
> + <qemu:arg value='socket,id=chr0,path=/tmp/sock0'/>
> + <qemu:arg value='-device'/>
> + <qemu:arg value='virtio-net-pci,netdev=vhost-net0'/>
> + <qemu:arg value='-netdev'/>
> + <qemu:arg value='vhost-user,id=vhost-net0,chardev=chr0,vhostforce'/>
> + <qemu:arg value='-chardev'/>
> + <qemu:arg value='socket,id=chr1,path=/tmp/sock1'/>
> + <qemu:arg value='-device'/>
> + <qemu:arg value='virtio-net-pci,netdev=vhost-net1'/>
> + <qemu:arg value='-netdev'/>
> + <qemu:arg value='vhost-user,id=vhost-net1,chardev=chr1,vhostforce'/>
> + </qemu:commandline>
> + </domain>
> +```
> +
> +### Trouble Shooting
> +
> +You might encounter a permission error for `tmp/sockN` because of appamor.
> +In this case, you should try it.
> +
> +```sh
> +$ sudo ln -s /etc/apparmor.d/usr.lib.libvirt.virt-aa-helper /etc/apparmor.d/disable/usr.lib.libvirt.virt-aa-helper
> +$ sudo ln -s /etc/apparmor.d/usr.sbin.libvirtd /etc/apparmor.d/disable/usr.sbin.libvirtd
> +$ sudo apparmor_parser -R /etc/apparmor.d/usr.lib.libvirt.virt-aa-helper
> +$ sudo apparmor_parser -R /etc/apparmor.d/usr.sbin.libvirtd
> +$ sudo service apparmor reload
> +$ sudo service apparmor restart
> +$ sudo service libvirt-bin restart
> +```
> +
> +Or, you remove appamor.
> +
> +```sh
> +$ sudo apt-get remove apparmor
> +```
> +
> +If you use CentOS, not Ubuntu, confirm that SELinux doesn't prevent for permission.
> +SELinux should be disabled in this case.
> +
> +```sh
> +# /etc/selinux/config
> +SELINUX=disabled
> +```
> +
> +Check your SELinux configuration.
> +
> +```sh
> +$ getenforce
> +Disabled
> +```
>
--
Yasufumi Ogawa
NTT Network Service Systems Labs
next prev parent reply other threads:[~2018-01-19 0:53 UTC|newest]
Thread overview: 97+ messages / expand[flat|nested] mbox.gz Atom feed top
2017-12-25 4:41 [spp] Proposal - spp_vf(SR-IOV like feature) addition to SPP Nakamura Hioryuki
2017-12-26 1:54 ` Yasufumi Ogawa
2017-12-28 4:55 ` [spp] [PATCH 01/57] spp_vf: add vf functions x-fn-spp
2017-12-28 8:49 ` Yasufumi Ogawa
2017-12-28 4:55 ` [spp] [PATCH 02/57] spp_vf: support multi process x-fn-spp
2018-02-07 16:50 ` Ferruh Yigit
2018-02-08 1:21 ` Yasufumi Ogawa
2018-02-08 6:44 ` [spp] [spp 02168] " Nakamura Hioryuki
2017-12-28 4:55 ` [spp] [PATCH 03/57] spp_vf: comment out check of using cores x-fn-spp
2017-12-28 4:55 ` [spp] [PATCH 04/57] spp_vf: modify classifier for upd command x-fn-spp
2017-12-28 4:55 ` [spp] [PATCH 05/57] spp_vf: add procedure that mac address is null x-fn-spp
2017-12-28 4:55 ` [spp] [PATCH 06/57] spp_vf: change config format for upd command x-fn-spp
2017-12-28 4:55 ` [spp] [PATCH 07/57] spp_vf: fix compiler warning in classifier_mac.c x-fn-spp
2017-12-28 4:55 ` [spp] [PATCH 08/57] spp_vf: modify data struct for upd command x-fn-spp
2017-12-28 4:55 ` [spp] [PATCH 09/57] spp_vf: add functions of command acceptance x-fn-spp
2017-12-28 4:55 ` [spp] [PATCH 10/57] spp_vf: add command acceptance calling x-fn-spp
2017-12-28 4:55 ` [spp] [PATCH 11/57] spp_vf: fix compiler warning in command_proc.c x-fn-spp
2017-12-28 4:55 ` [spp] [PATCH 12/57] " x-fn-spp
2017-12-28 4:55 ` [spp] [PATCH 13/57] spp_vf: refactor command acceptance/decode x-fn-spp
2017-12-28 4:55 ` [spp] [PATCH 14/57] spp_vf: fix return value overwrite problem x-fn-spp
2017-12-28 4:55 ` [spp] [PATCH 15/57] spp_vf: initialize message buffer x-fn-spp
2017-12-28 4:55 ` [spp] [PATCH 16/57] spp_vf: add const keyword to parameter x-fn-spp
2017-12-28 4:55 ` [spp] [PATCH 17/57] spp_vf: fix wrong comparison operator x-fn-spp
2017-12-28 4:55 ` [spp] [PATCH 18/57] spp_vf: fix wrong variable to be assigned x-fn-spp
2017-12-28 4:55 ` [spp] [PATCH 19/57] spp_vf: refactor parsing server ip address x-fn-spp
2017-12-28 4:55 ` [spp] [PATCH 20/57] spp_vf: fix error in command decode x-fn-spp
2017-12-28 4:55 ` [spp] [PATCH 21/57] spp_vf: fix comparison operator in spp_vf.c x-fn-spp
2017-12-28 4:55 ` [spp] [PATCH 22/57] spp_vf: check upper limit to the number of process x-fn-spp
2017-12-28 4:55 ` [spp] [PATCH 23/57] spp_vf: display usage message x-fn-spp
2017-12-28 4:55 ` [spp] [PATCH 24/57] spp_vf: split command processing source file x-fn-spp
2017-12-28 4:55 ` [spp] [PATCH 25/57] spp_vf: add new log and line break x-fn-spp
2017-12-28 4:55 ` [spp] [PATCH 26/57] spp_vf: support get-process-id command x-fn-spp
2017-12-28 4:55 ` [spp] [PATCH 27/57] spp_vf: update socket creation procedure x-fn-spp
2017-12-28 4:55 ` [spp] [PATCH 28/57] spp_vf: change log level and add line break x-fn-spp
2017-12-28 4:55 ` [spp] [PATCH 29/57] spp_vf: replace unsupported jansson api x-fn-spp
2017-12-28 4:55 ` [spp] [PATCH 30/57] spp_vf: change order of command result in json object x-fn-spp
2017-12-28 4:55 ` [spp] [PATCH 31/57] spp_vf: use prediction keywords x-fn-spp
2017-12-28 4:55 ` [spp] [PATCH 32/57] spp_vf: fix wrong comparison x-fn-spp
2017-12-28 4:55 ` [spp] [PATCH 33/57] spp_vf: update sending error status x-fn-spp
2017-12-28 4:55 ` [spp] [PATCH 34/57] spp_vf: modify conditional statement x-fn-spp
2017-12-28 4:55 ` [spp] [PATCH 35/57] spp_vf: add proc on receiving l2 multicast x-fn-spp
2017-12-28 4:55 ` [spp] [PATCH 36/57] spp_vf: extend limit on number of usable cores x-fn-spp
2017-12-28 4:55 ` [spp] [PATCH 37/57] spp_vf: add restart procedure for vhost client x-fn-spp
2017-12-28 4:55 ` [spp] [PATCH 38/57] spp_vf: fix classifier mbuf handling x-fn-spp
2017-12-28 4:55 ` [spp] [PATCH 39/57] spp_vf: add status command x-fn-spp
2017-12-28 4:55 ` [spp] [PATCH 40/57] spp_vf: add output source information in error log x-fn-spp
2017-12-28 4:55 ` [spp] [PATCH 41/57] spp_vf: change function names x-fn-spp
2017-12-28 4:55 ` [spp] [PATCH 42/57] spp_vf: change how to request commands x-fn-spp
2017-12-28 4:55 ` [spp] [PATCH 43/57] spp_vf: update command decode procedure x-fn-spp
2017-12-28 4:55 ` [spp] [PATCH 44/57] spp_vf: remove debug log output procedures x-fn-spp
2017-12-28 4:55 ` [spp] [PATCH 45/57] spp_vf: improve command_decoder program code x-fn-spp
2017-12-28 4:55 ` [spp] [PATCH 46/57] spp_vf: fix a bug in status command x-fn-spp
2017-12-28 4:55 ` [spp] [PATCH 47/57] spp_vf: add spp_vf.py instead of spp.py x-fn-spp
2017-12-28 4:55 ` [spp] [PATCH 48/57] spp_vf: refactor for commnets in spp_vf.c x-fn-spp
2017-12-28 4:55 ` [spp] [PATCH 49/57] spp_vf: refactor comments in classifier_mac.c x-fn-spp
2017-12-28 4:55 ` [spp] [PATCH 50/57] spp_vf: refactor comments in spp_forward.c x-fn-spp
2017-12-28 4:55 ` [spp] [PATCH 51/57] spp_vf: refactor for commnets in spp_config.c x-fn-spp
2017-12-28 4:55 ` [spp] [PATCH 52/57] spp_vf: refactor no self-explanatory comments x-fn-spp
2017-12-28 4:56 ` [spp] [PATCH 53/57] spp_vf: correct typo of function name x-fn-spp
2017-12-28 4:56 ` [spp] [PATCH 54/57] spp_vf: support new command x-fn-spp
2017-12-28 4:56 ` [spp] [PATCH 55/57] spp_vf: add display of status command x-fn-spp
2017-12-28 4:56 ` [spp] [PATCH 56/57] spp_vf: fix " x-fn-spp
2017-12-28 4:56 ` [spp] [PATCH 57/57] spp_vf: fix l2 multicast packet forwarding x-fn-spp
2018-01-15 11:04 ` [spp] Proposal - spp_vf(SR-IOV like feature) addition to SPP Ferruh Yigit
2018-01-16 5:16 ` [spp] [PATCH 01/30] doc: add setup guide x-fn-spp
2018-01-19 0:52 ` Yasufumi Ogawa [this message]
2018-01-22 14:37 ` Ferruh Yigit
2018-01-23 0:25 ` Yasufumi Ogawa
2018-01-16 5:16 ` [spp] [PATCH 02/30] doc: add how_to_use.md x-fn-spp
2018-01-16 5:16 ` [spp] [PATCH 03/30] doc: add config_manual.md x-fn-spp
2018-01-16 5:16 ` [spp] [PATCH 04/30] doc: add spp_vf.md x-fn-spp
2018-01-16 5:16 ` [spp] [PATCH 05/30] doc: revise spp_vf.md x-fn-spp
2018-01-16 5:16 ` [spp] [PATCH 06/30] doc: add config section x-fn-spp
2018-01-16 5:16 ` [spp] [PATCH 07/30] doc: update jp setup manual x-fn-spp
2018-01-16 5:16 ` [spp] [PATCH 08/30] doc: modify figure in spp_vf_overview x-fn-spp
2018-01-16 5:16 ` [spp] [PATCH 09/30] doc: fix " x-fn-spp
2018-01-16 5:16 ` [spp] [PATCH 10/30] doc: fix figure in overview x-fn-spp
2018-01-16 5:16 ` [spp] [PATCH 11/30] doc: add sample usage x-fn-spp
2018-01-16 5:16 ` [spp] [PATCH 12/30] doc: revice path descs x-fn-spp
2018-01-16 5:16 ` [spp] [PATCH 13/30] doc: add network configuration diagram x-fn-spp
2018-01-16 5:16 ` [spp] [PATCH 14/30] doc: update user account x-fn-spp
2018-01-16 5:16 ` [spp] [PATCH 15/30] doc: update descriptions for todo x-fn-spp
2018-01-16 5:16 ` [spp] [PATCH 16/30] doc: add description for explanation section x-fn-spp
2018-01-16 5:16 ` [spp] [PATCH 17/30] doc: add spp_sample_usage_svg in docs/spp_vf/ x-fn-spp
2018-01-16 5:16 ` [spp] [PATCH 18/30] doc: add explanation for terminating spp app x-fn-spp
2018-01-16 5:16 ` [spp] [PATCH 19/30] doc: add explanations on options of spp x-fn-spp
2018-01-16 5:16 ` [spp] [PATCH 20/30] doc: update description for the latest spp version x-fn-spp
2018-01-16 5:16 ` [spp] [PATCH 21/30] doc: update description on dpdk version x-fn-spp
2018-01-16 5:16 ` [spp] [PATCH 22/30] doc: fix vm setup procedure for network config x-fn-spp
2018-01-16 5:16 ` [spp] [PATCH 23/30] doc: update jansson installation procedure x-fn-spp
2018-01-16 5:16 ` [spp] [PATCH 24/30] doc: fix required network configuration x-fn-spp
2018-01-16 5:16 ` [spp] [PATCH 25/30] doc: add how to use vhost-user support x-fn-spp
2018-01-16 5:16 ` [spp] [PATCH 26/30] doc: add references to hugepages and isolcpus x-fn-spp
2018-01-16 5:16 ` [spp] [PATCH 27/30] doc: remove description on classifier_table x-fn-spp
2018-01-16 5:16 ` [spp] [PATCH 28/30] doc: fix typos and erros in texts x-fn-spp
2018-01-16 5:16 ` [spp] [PATCH 29/30] doc: update sample config section x-fn-spp
2018-01-16 5:16 ` [spp] [PATCH 30/30] doc: align figure title position x-fn-spp
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=02b1f8d7-bbab-49db-acd8-941993b43827@lab.ntt.co.jp \
--to=ogawa.yasufumi@lab.ntt.co.jp \
--cc=spp@dpdk.org \
--cc=x-fn-spp@sl.ntt-tx.co.jp \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).