TypeError: Type is not JSON serializable: numpy.ndarray/recarray #729

Problem

We probed JSON serialization with crate-python and discovered it does not work well in all situations yet, for example when the data payload includes an array/list, and is read from JSON using pandas or Polars.

{"foo":"bar","baz":["qux"]}

The reason is that the decoded payload includes numpy.ndarray or recarray types.

Reproduce

cratedb-orjson.py can be used to reproduce the problem.

References

• cfr sys-import: Importing table failed: XXX. Reason: Type is not JSON serializable: numpy.ndarray cratedb-toolkit#482