From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <dev-bounces@dpdk.org>
Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124])
	by inbox.dpdk.org (Postfix) with ESMTP id 04420439B8;
	Wed, 24 Jan 2024 19:11:34 +0100 (CET)
Received: from mails.dpdk.org (localhost [127.0.0.1])
	by mails.dpdk.org (Postfix) with ESMTP id E327D402A6;
	Wed, 24 Jan 2024 19:11:33 +0100 (CET)
Received: from outbound.mail.protection.outlook.com
 (mail-dm6nam12on2064.outbound.protection.outlook.com [40.107.243.64])
 by mails.dpdk.org (Postfix) with ESMTP id 0ED9D40262
 for <dev@dpdk.org>; Wed, 24 Jan 2024 19:11:32 +0100 (CET)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none;
 b=AdRcbFIhuHX1BchDECpzQuHkP1NLqCn3XSOz2Xc245a+wHoM8/HJrgpVnxZB7maFpmPj6Mp2h4xwiWk8CwhEeMxqVMIH4B0M94EdDWJ9lVBijYX6NaPOL8+TPv6at/1G4Xtn+zE/7ZxyWeQEp6ImZPl9CClyc+ZiJ5N0pTM9wJHHWov/8y42BrwzsmyKfIflnnmYpGav9mG8wYydTbqmlwdQgtuqj1bDK1XNiSZi8g2gTgsz1CtT9bYtrssZfS4m1ssJDF3XAwFkPIpFd8D3uKjKndM7OQXuaGmJuDl+JatN9utUkpHaoKPSjFudwuvE8yYWwz8Rjj8ZoPdGmckBXg==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; 
 s=arcselector9901;
 h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1;
 bh=g2w06Vq1p2ScXTqb4En1lM+8blzhlDXReLhmAYGKWpI=;
 b=JOqpj6SWZc5x1It6qZBdGNkfwu6bJkVvomw6gflF8rFc/Hm0kRBmfd8oxGq5te992j/YMWlJgZDCf9B2qi8XdZeCDZm/kpgf8xekFq8KUT3WLEfbrKJn7t4pH/yZa6DBrsIoKnLZ37ox65q2AkZVzu4E5Ouycx2cK6fIsZkaXe1tkWHZ5SkQSiJNiSU3lnn5mR73E6N2FKrWYnBxPiWV9WQ6CQdt9SvnyCKxTudxmlD5w6h2PCVev7ccnwNIS7NSaAO0Cc7LK0mbV+HkWnzo4gsUDQe5C5W6VeQ7TuBsIvV7/9f7wvPMix7bf6L3w3V7ukf0gbpi3U5JK0BhmLr4xw==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass
 smtp.mailfrom=amd.com; dmarc=pass action=none header.from=amd.com; dkim=pass
 header.d=amd.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=amd.com; s=selector1; 
 h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck;
 bh=g2w06Vq1p2ScXTqb4En1lM+8blzhlDXReLhmAYGKWpI=;
 b=yfdFFUEdA+5LqYNo2N1A/Dmc5qgMMCvyv1vCaQOei9XoWCaS9OKABbNGbj6bH/+r1uE1EqzhR04xHwUq0E/rmixnFDT2u+jrJBc0/BMoiQVRXtK/9pDSkeG9pTq/sy6cd28+TYdVVVYpil4ZClSLDQTWnITQ4PvGDSUaJEATNt4=
Authentication-Results: dkim=none (message not signed)
 header.d=none;dmarc=none action=none header.from=amd.com;
Received: from PH7PR12MB8596.namprd12.prod.outlook.com (2603:10b6:510:1b7::6)
 by CY8PR12MB9033.namprd12.prod.outlook.com (2603:10b6:930:71::7) with
 Microsoft SMTP Server (version=TLS1_2,
 cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7228.24; Wed, 24 Jan
 2024 18:11:29 +0000
Received: from PH7PR12MB8596.namprd12.prod.outlook.com
 ([fe80::120d:8f4f:a6d2:606f]) by PH7PR12MB8596.namprd12.prod.outlook.com
 ([fe80::120d:8f4f:a6d2:606f%3]) with mapi id 15.20.7228.023; Wed, 24 Jan 2024
 18:11:28 +0000
Content-Type: multipart/alternative;
 boundary="------------HugYPXOC4v2vwyTVsilEw0LS"
Message-ID: <c9ab40d5-d0bf-4963-90df-aaa26823401d@amd.com>
Date: Wed, 24 Jan 2024 23:41:20 +0530
User-Agent: Mozilla Thunderbird
Subject: Re: [RFC] doc/linux_gsg: add amd configuration section
To: Thomas Monjalon <thomas@monjalon.net>
Cc: dev@dpdk.org, Neerav.Parikh@amd.com, Ferruh.Yigit@amd.com,
 Clinton.France@amd.com
References: <20231010153409.1701-1-vipin.varghese@amd.com>
 <1893718.tdWV9SEqCh@thomas>
Content-Language: en-US
From: "Varghese, Vipin" <vipin.varghese@amd.com>
In-Reply-To: <1893718.tdWV9SEqCh@thomas>
X-ClientProxiedBy: PN2PR01CA0122.INDPRD01.PROD.OUTLOOK.COM
 (2603:1096:c01:6::7) To PH7PR12MB8596.namprd12.prod.outlook.com
 (2603:10b6:510:1b7::6)
MIME-Version: 1.0
X-MS-PublicTrafficType: Email
X-MS-TrafficTypeDiagnostic: PH7PR12MB8596:EE_|CY8PR12MB9033:EE_
X-MS-Office365-Filtering-Correlation-Id: 003ba9ae-078a-416d-a50a-08dc1d07e263
X-MS-Exchange-SenderADCheck: 1
X-MS-Exchange-AntiSpam-Relay: 0
X-Microsoft-Antispam: BCL:0;
X-Microsoft-Antispam-Message-Info: dWLber9HxkFpOawIPmUzY7/8ih+48mGK/I6IcR5zCnC8cNNpGE3+UXXJCxkdvkGhQXKgtUUPcHA653DLAwJgKokxThL2BH+3rLg2/JJw4eRqdupJte5UYP/yyTWwOFzyBsX0psDXzadE9bVXxNTGtiLToJEAWMX4kd8iqA1uek2m/M1j77CUZY7cts+Zh+KldrNgIvZq4qd9w0QCWCEhjgrOcjQVdSggTxaY5h8soBkMyzNV2aHdfirgTREhJIfdxZOLSTIFN9OgJB4lRXO3zMzvWTQaO2WAfoiIZdflPJUmz2NsJNWKF12deZxEKwNUHszVIGmoZAIDygCQync4Zw5S+zJqR6NghUeL3wBew1zlNNp/tWjxBe4QeihA2kI22dmOAGpIpRoAeByO2elvjBP0uiDZ7Ww5626wDp54chkIcVY866VF0zLvyMPpXgDn1CjsAukpFpOc9ijp+c5N7OwViMHs5YlCJw89vbUq5BZUFPmRr2z+9r1JTFARfqjoCNRO+JE4+lAMtHuItpB/SVtDBSRzB9P+SOHC1nQZtpUmm+RSJIPr3OkiJrs6UTiiDySRJAAIZAmtNbd2IEBgjsVCFhZE2tGOrOtA+3SOS9HGHibZqdTYed/nTv7XED/6gXPsvOxR0S1DmtyaGZh1rRSbC4GKtOyATp9S/UsYrCGIjI5LWqmSLyVUACiN9QMRjKxFaPEsvT1xL7u5a0xM1YsKs4Sx5C4mGEyw810YxmA=
X-Forefront-Antispam-Report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:;
 IPV:NLI; SFV:NSPM; H:PH7PR12MB8596.namprd12.prod.outlook.com; PTR:; CAT:NONE;
 SFS:(13230031)(366004)(39860400002)(346002)(136003)(376002)(396003)(230173577357003)(230922051799003)(230273577357003)(1800799012)(186009)(451199024)(64100799003)(41300700001)(31686004)(26005)(36756003)(38100700002)(478600001)(33964004)(6512007)(6506007)(83380400001)(2616005)(6666004)(53546011)(166002)(5660300002)(66476007)(6486002)(66556008)(2906002)(31696002)(66899024)(66946007)(316002)(86362001)(6916009)(8936002)(8676002)(4326008)(45980500001)(43740500002);
 DIR:OUT; SFP:1101; 
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?bTRGWThjYXBFV3NJQ044TUcwL2w0VGxMVEplRENxZ0ZtMEo5dTJoeTRsbkw4?=
 =?utf-8?B?QXFYd3V3ajVwNmVvNDRBdjBzQXFHOEtoVkdGbWI3Wm92Y01qelVDMVhMdHR0?=
 =?utf-8?B?aTdQODdmcGhDNE10NFlrQ1dZMzNOa21iSzl4b3ZhSmhKT0c5UVFGRDIxaHhJ?=
 =?utf-8?B?c0hPVUhHbXp6WnNOTXlIZ2lDdkxodTJkYUVGbTM3b21pZVBOYWJYMUdxblpw?=
 =?utf-8?B?bTZ2c0lBVEJ5a1pSanpzNWE3SHllQnExdmRkVWUwS0NmeHZsZ1dvSi94aGZn?=
 =?utf-8?B?MjJPSmk3L1pNVnRodWVYbnIvTTMvQVdTdHc4azI5eXo0enJTNE11QzFTYWdn?=
 =?utf-8?B?N1EwTDMvKys3UkhFR0JlREZPNUFlMnErbDRFZHY5MnZJYlkxUDBnYXFRK2JX?=
 =?utf-8?B?bnVJRzJBcjgxZkNURjJXRFprV3haZ3cxaUF4US9FNEJFekpkbmtWRFhkcUhX?=
 =?utf-8?B?ZHpUdU5mWmlaWEJERGxtZUo3azVGVTJvTlVkeDl4Q3JxK08yZ2xlVVFnVkor?=
 =?utf-8?B?UXNac3pIVzRlU0cxNnk0RGhER0tseEZnY1lLQ2M4TW9BQ2c3U2FRVlFBU2N1?=
 =?utf-8?B?ekIwbDZTWkc0SFZPK09oakJJZUlHY0lyeVVkWDJGRXlFYy9GcWVYQU51ZnFS?=
 =?utf-8?B?Q2ZLNm16d0R6K3phTGZmNk5IOGw5RHV1cFhIZVNOeEQ3c2JIcTNXdWdFSmR6?=
 =?utf-8?B?N1hpYTNrVXAwM1ptYTNpVnFrWUZoNzBoSXZCTzRJZmFWcDhmYmhSZzNrdU5u?=
 =?utf-8?B?MmtjYktnamlkR2dOSGV5dTFXV0ZmVlVkSlpqUTA1UEZjdGN2cGhFSEpTNS9w?=
 =?utf-8?B?bm5saGFUZWE1U1BPSHZrUFNvZ1JkekxzSjZtWFpvckUrSmlJcHRWOU5KelZk?=
 =?utf-8?B?ODk1R0xKZkJFbnNBRjdyWDgrRm5takpZTmpwdUlTbFZOU1B2UmhnK1ZkT3c0?=
 =?utf-8?B?alJUUENDYkN1eWt4eUJlVDUzOWJBVDZROUNDeWk1ZUV6L0x5ZUdpTm5KY01N?=
 =?utf-8?B?L3lpQ2ExOE9CMFkrTUtmeW1CVjVlb3BpWUZEV2hrOXo2QkY0OUJHV0NuVS9m?=
 =?utf-8?B?T1d6Qy84eHg0V3RTTUJNMlF5L2RMa2FIejJTcjExUDMxN3puT2ZhcFJ1WTEr?=
 =?utf-8?B?bkQwd1B3MjMydnZCSU1qUnFDa0EyRWpnOXN3UWhKbEpWckFYNVRiYUJGMlBI?=
 =?utf-8?B?cnA0dDJYa1k3dkFsUkdIZElxdzNWWmdEaVBTZmJFTnRXOXpSbEJDMzV4empt?=
 =?utf-8?B?ZzJNckI1ZndEVG5MRGZHQ0RCaEdibW1jWGU5bHk3T0RVWVo2QXN1VEVvKzE3?=
 =?utf-8?B?ZXNyOU0rbmpkUE9PUEV5VFI4SXh1OUlaQ2ZEbnErU3JvZXRYa1kzUmZBM1BK?=
 =?utf-8?B?SCtDcVpVTHNtTTQ1RjhoMVlwZFQ5OG0zdEVZM05KelVvQWd3U05kcjN3Nnhy?=
 =?utf-8?B?T25Dc0VCUFQ5aHgvYXhuNU9xa09uZk9vditWWmdoUytKNktSWUQ5MEFrWEhD?=
 =?utf-8?B?Vi84V3lWRktWMmNxa256M2VidjZqVGVjRHRhUnNGeDlYS1I5OGIzNU9kMWN4?=
 =?utf-8?B?bmdKRmo4QzBDMlQrVWxVYW9yMGtLTy9pUlc0Nk9FMGpTR205MktSdDFackZ0?=
 =?utf-8?B?UkZvL2FFdnZsMWt4V3gxbnpkQTE2UTkxQktlSWtXblNSbVBoSE9lNVdoZmVJ?=
 =?utf-8?B?R2h1a0YxdC9qRmw0cHlBNFoxd1JjcDgwV3I5Zk0rYW85Z1F2VmZoVDBLbkli?=
 =?utf-8?B?ZlZ0MlFlMmx4RW9wK2dvYSttemJvd3E4YkdQTlVMR2lKZ2hHZFBKMUNFeWh4?=
 =?utf-8?B?b2JRL0ZiVVVRLzlsYTBpNGlsQnoxcWxDS1U4K3QzRzJFVEh0T2lPaTJ6TUZR?=
 =?utf-8?B?QmUzbVVoL0R0cDNZekNRT1JjUjQyNyswOVpvaFhWTEdVcGZZWmI5d092R1NT?=
 =?utf-8?B?cUpmVUJOMGVkSVZEeklkSXZodkVnQktNRVVDaW5QUkVWN20wUDQ0UHFqdDhC?=
 =?utf-8?B?TE0vOHhHR3VwcUpudjZ4aTdnY2M0VGg4WkVWSXVOZ29rQkpqbC93UGI1WkFj?=
 =?utf-8?B?RjJzTk9mMUZZZHJQYXcrUGpTRUd3VGNIbXdzQXgzMFllUGpyR1JwaVhFM0pK?=
 =?utf-8?Q?Mcd/SL5Okz090usKD75jHd4AL?=
X-OriginatorOrg: amd.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 003ba9ae-078a-416d-a50a-08dc1d07e263
X-MS-Exchange-CrossTenant-AuthSource: PH7PR12MB8596.namprd12.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 24 Jan 2024 18:11:28.4567 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 3dd8961f-e488-4e60-8e11-a82d994e183d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: jsTME1XZgOnzdhBtBO24tHw+/Jp1LlyERFSE+ElArjzWWXjY0nC46NA4KfZGcXhPm5ACqLaTE4EU03nGkWb++g==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: CY8PR12MB9033
X-BeenThere: dev@dpdk.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: DPDK patches and discussions <dev.dpdk.org>
List-Unsubscribe: <https://mails.dpdk.org/options/dev>,
 <mailto:dev-request@dpdk.org?subject=unsubscribe>
List-Archive: <http://mails.dpdk.org/archives/dev/>
List-Post: <mailto:dev@dpdk.org>
List-Help: <mailto:dev-request@dpdk.org?subject=help>
List-Subscribe: <https://mails.dpdk.org/listinfo/dev>,
 <mailto:dev-request@dpdk.org?subject=subscribe>
Errors-To: dev-bounces@dpdk.org

--------------HugYPXOC4v2vwyTVsilEw0LS
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit


On 1/16/2024 8:44 PM, Thomas Monjalon wrote:
> Caution: This message originated from an External Source. Use proper caution when opening attachments, clicking links, or responding.
>
>
> There was no comment on this doc.
> It is RFC, is it ready to merge?

new patch shared doc/linux_gsg: add amd configuration section - 
Patchwork (dpdk.org) 
<https://patchwork.dpdk.org/project/dpdk/patch/20240124181021.1759-1-vipin.varghese@amd.com/>


>
> Instead of the Linux guide, should we add it to the platform guides?
>          doc/guides/platform/
>
> We may want to create an entry in MAINTAINERS as well.

thank you, added the same under `AMD x86`

>
> More details below.
>
>
> 10/10/2023 17:34, Vipin Varghese:
>> Add AMD EPYC SoC tuning guide as new setcion of linux getting
> typo: section
fixed, spell check did not catch this for me. My mistake
>> started guide.
>>
>> Signed-off-by: Vipin Varghese<vipin.varghese@amd.com>
>> ---
>> +This document shares step-by-step guide for configuring AMD EPYC SoC across various families for getting best performance for DPDK applications.
>> +Various factors like BIOS, Numa Per Socket, Memory per Numa, near-far from IO device affects the overall performance.
> Numa -> NUMA
changed to all capital
>> +
>> +These are covered in various sections of tuning guides shared below.
>> +
>> +
>> +Tuning Guide for AMD EPYC SoC
>> +-----------------------------
>> +
>> +#. `MILAN<https://www.amd.com/content/dam/amd/en/documents/epyc-technical-docs/tuning-guides/data-plane-development-kit-tuning-guide-amd-epyc7003-series-processors.pdf>`_
>> +
>> +#. `GENOA<https://www.amd.com/content/dam/amd/en/documents/epyc-technical-docs/tuning-guides/58017-amd-epyc-9004-tg-data-plane-dpdk.pdf>`_
>> +
>> +#. `BERGAMO|SIENNA<https://www.amd.com/content/dam/amd/en/documents/epyc-technical-docs/tuning-guides/58310_amd-epyc-8004-tg-data-plane-dpdk.pdf>`_
>> +
>> +
>> +General Requirements
>> +--------------------
>> +
>> +Memory
>> +~~~~~~
>> +
>> +Refer `Memory Configuration` section for SoC specific details.
>> +
>> +Note: general thumb rule is to ensure that each memory channel has at least one memory DIMM populated. The ideal memory size for each is at least 8|16|32 GB ECC modules.
> Please start a new sentence on a new line.
correction applied.
>
--------------HugYPXOC4v2vwyTVsilEw0LS
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: 7bit

<!DOCTYPE html><html><head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
  </head>
  <body>
    <p><br>
    </p>
    <div class="moz-cite-prefix">On 1/16/2024 8:44 PM, Thomas Monjalon
      wrote:<br>
    </div>
    <blockquote type="cite" cite="mid:1893718.tdWV9SEqCh@thomas">
      <pre class="moz-quote-pre" wrap="">Caution: This message originated from an External Source. Use proper caution when opening attachments, clicking links, or responding.


There was no comment on this doc.
It is RFC, is it ready to merge?</pre>
    </blockquote>
    <p>new patch shared <a href="https://patchwork.dpdk.org/project/dpdk/patch/20240124181021.1759-1-vipin.varghese@amd.com/">doc/linux_gsg:
        add amd configuration section - Patchwork (dpdk.org)</a></p>
    <p><br>
    </p>
    <blockquote type="cite" cite="mid:1893718.tdWV9SEqCh@thomas">
      <pre class="moz-quote-pre" wrap="">

Instead of the Linux guide, should we add it to the platform guides?
        doc/guides/platform/

We may want to create an entry in MAINTAINERS as well.</pre>
    </blockquote>
    <p>thank you, added the same under `AMD x86`<br>
    </p>
    <blockquote type="cite" cite="mid:1893718.tdWV9SEqCh@thomas">
      <pre class="moz-quote-pre" wrap="">

More details below.


10/10/2023 17:34, Vipin Varghese:
</pre>
      <blockquote type="cite">
        <pre class="moz-quote-pre" wrap="">Add AMD EPYC SoC tuning guide as new setcion of linux getting
</pre>
      </blockquote>
      <pre class="moz-quote-pre" wrap="">
typo: section
</pre>
    </blockquote>
    fixed, spell check did not catch this for me. My mistake<br>
    <blockquote type="cite" cite="mid:1893718.tdWV9SEqCh@thomas">
      <pre class="moz-quote-pre" wrap="">
</pre>
      <blockquote type="cite">
        <pre class="moz-quote-pre" wrap="">started guide.

Signed-off-by: Vipin Varghese <a class="moz-txt-link-rfc2396E" href="mailto:vipin.varghese@amd.com">&lt;vipin.varghese@amd.com&gt;</a>
---
+This document shares step-by-step guide for configuring AMD EPYC SoC across various families for getting best performance for DPDK applications.
+Various factors like BIOS, Numa Per Socket, Memory per Numa, near-far from IO device affects the overall performance.
</pre>
      </blockquote>
      <pre class="moz-quote-pre" wrap="">
Numa -&gt; NUMA
</pre>
    </blockquote>
    changed to all capital<br>
    <blockquote type="cite" cite="mid:1893718.tdWV9SEqCh@thomas">
      <pre class="moz-quote-pre" wrap="">
</pre>
      <blockquote type="cite">
        <pre class="moz-quote-pre" wrap="">+
+These are covered in various sections of tuning guides shared below.
+
+
+Tuning Guide for AMD EPYC SoC
+-----------------------------
+
+#. `MILAN <a class="moz-txt-link-rfc2396E" href="https://www.amd.com/content/dam/amd/en/documents/epyc-technical-docs/tuning-guides/data-plane-development-kit-tuning-guide-amd-epyc7003-series-processors.pdf">&lt;https://www.amd.com/content/dam/amd/en/documents/epyc-technical-docs/tuning-guides/data-plane-development-kit-tuning-guide-amd-epyc7003-series-processors.pdf&gt;</a>`_
+
+#. `GENOA <a class="moz-txt-link-rfc2396E" href="https://www.amd.com/content/dam/amd/en/documents/epyc-technical-docs/tuning-guides/58017-amd-epyc-9004-tg-data-plane-dpdk.pdf">&lt;https://www.amd.com/content/dam/amd/en/documents/epyc-technical-docs/tuning-guides/58017-amd-epyc-9004-tg-data-plane-dpdk.pdf&gt;</a>`_
+
+#. `BERGAMO|SIENNA <a class="moz-txt-link-rfc2396E" href="https://www.amd.com/content/dam/amd/en/documents/epyc-technical-docs/tuning-guides/58310_amd-epyc-8004-tg-data-plane-dpdk.pdf">&lt;https://www.amd.com/content/dam/amd/en/documents/epyc-technical-docs/tuning-guides/58310_amd-epyc-8004-tg-data-plane-dpdk.pdf&gt;</a>`_
+
+
+General Requirements
+--------------------
+
+Memory
+~~~~~~
+
+Refer `Memory Configuration` section for SoC specific details.
+
+Note: general thumb rule is to ensure that each memory channel has at least one memory DIMM populated. The ideal memory size for each is at least 8|16|32 GB ECC modules.
</pre>
      </blockquote>
      <pre class="moz-quote-pre" wrap="">
Please start a new sentence on a new line.
</pre>
    </blockquote>
    correction applied.<br>
    <blockquote type="cite" cite="mid:1893718.tdWV9SEqCh@thomas">
      <pre class="moz-quote-pre" wrap="">

</pre>
    </blockquote>
  </body>
</html>

--------------HugYPXOC4v2vwyTVsilEw0LS--