too many values for field - { type: 'array', items: [ { type: 'number' }] }

[helxsz]

my json schema is as followed

{
  type: 'object',
  properties: {
    coordinate: { type: 'array', items: [ { type: 'number' }] },
    report_year: { type: 'string', format: 'date-time' }
  }
}

const writeParquet = async ( jsonschema:any, dataList:any[], filename:string) => {
  const parquetSchema =  ParquetSchema.fromJsonSchema(jsonschema);
  const parquetPath = join(process.cwd(), 'temp', filename );
  const writer = await ParquetWriter.openFile(parquetSchema, parquetPath);
  dataList.forEach(async item => {
    try{
      await writer.appendRow(item);
    }catch(err){
      console.log(err);
    }
  });
  await writer.close();
  return parquetPath;
}

let dataitem = {
    coordinate: [ 119.602407407407, 29.9779320987654 ],
    report_year: '2020-12-31T16:00:00.000Z',
}
let parquetPath =  writeParquet( jsonschema, [dataitem],  'afd.parquet' );

but I got an error saying 'too many values for field: coordinate'.

any idea how to deal with it?

[cjkeilig]

I saw the example in the code base, for coordinate it could be { type: 'FLOAT', repeated: true }

[helxsz]

thanks, @cjkeilig , yes, it is all right to work with { type: 'FLOAT', repeated: true }. But in my case, we don't declare the native schema directly but declare the json schema.

it seems if I pass the json schema with a array like this coordinate: { type: 'array', items: [ { type: 'number' }] }, it will throw out an exception like this.