Form Data provider cannot read from JSON file with encoding UTF--8 with BOM

• Type: Bug
• Status: Closed
• Resolution: Fixed
• Affects Version/s: 7.0.X, 7.1.X, 7.2.X, Master
• Fix Version/s: 7.0.10.14 DXP SP14, 7.0.X, 7.1.10 DXP FP18, 7.1.10.5 SP5, 7.1.X, 7.2.X, 7.3.1 CE GA2, 7.3.2 CE GA3, 7.3.10 DXP GA1, Master
• Component/s: Forms
• Labels:
  • INACTIVE
  • backend_test
  • ee-ts
  • liferay-dxp-70-sp14
  • liferay-dxp-71-sp5
  • liferay-fixpack-de-91-7010
  • liferay-fixpack-dxp-18-7110
  • liferay-fixpack-dxp-5-7210
• Branch Version/s:
  7.2.x, 7.1.x, 7.0.x
• Backported to Branch:
  Committed
• Fix Priority: 3
• Git Pull Request: https://github.com/brianchandotcom/liferay-portal/pull/84798

*Steps to reproduce: *

On 7.2 and above it is needed to allow access to local network:

Control Panel -> Configuration -> System Settings -> Data provider -> check "Access Local Network"

1. Open the attached list.json with some text editor which enables you to save it with specific encoding (I used Notepad++). Save the file with "UTF-8 with BOM" encoding. (The file already should use that encoding, but just to be sure)
2. Add the list.json file to Documents and Media.
3. From the document details, get its URL.
4. In Content/Forms, add a new data provider with the URL obtained in step 3 (Displayed JSON Attribute = color and Stored JSON Attribute = value and Type= List)
5. Create a new form where you place a "Select from list" field using the data provider created in step 4.
6. Place a Form portlet on some portal page and select the Form created in step 5.

Result: the dropdown field is not populated and in the browser's Network and Console tab you will see that the data provider URL is giving HTTP-400 response.
(URL is something like /o/dynamic-data-mapping-data-provider/?ddmDataProviderInstanceId=XXXXXX)

Also note that if the json file is saved with just UTF-8 encoding without BOM, everything works.