admin管理员组

文章数量:1550528

python 3.9 执行 `from datasets import load_dataset`时出现如下错误：

Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/home/hanhq/anaconda3/lib/python3.9/site-packages/datasets/__init__.py", line 18, in <module>
    from .arrow_dataset import Dataset
  File "/home/hanhq/anaconda3/lib/python3.9/site-packages/datasets/arrow_dataset.py", line 67, in <module>
    from .arrow_reader import ArrowReader
  File "/home/hanhq/anaconda3/lib/python3.9/site-packages/datasets/arrow_reader.py", line 29, in <module>
    import pyarrow.parquet as pq
  File "/home/hanhq/anaconda3/lib/python3.9/site-packages/pyarrow/parquet/__init__.py", line 20, in <module>
    from .core import *
  File "/home/hanhq/anaconda3/lib/python3.9/site-packages/pyarrow/parquet/core.py", line 52, in <module>
    from pyarrow.fs import (LocalFileSystem, FileSystem, FileType,
  File "/home/hanhq/anaconda3/lib/python3.9/site-packages/pyarrow/fs.py", line 49, in <module>
    from pyarrow._gcsfs import GcsFileSystem  # noqa
  File "pyarrow/_gcsfs.pyx", line 1, in init pyarrow._gcsfs
ValueError: pyarrow.lib.NativeFile size changed, may indicate binary incompatibility. Expected 104 from C header, got 96 from PyObject

解决办法：

我的安装了12.0.1的pyarrow就可以了

pip install pyarrow==12.0.1
pip install cchardet

另一个解决方法

pip install pyarrow==11.0.0

参考：Cannot import datasets - ValueError: pyarrow.lib.IpcWriteOptions size changed, may indicate binary incompatibility · Issue #5923 · huggingface/datasets · GitHub 

本文标签： 解决办法错误libNativeFileValueError

版权声明：本文标题：ValueError: pyarrow.lib.NativeFile size changed, may indicate binary incompatibility. 错误解决办法 内容由热心网友自发贡献，该文观点仅代表作者本人， 转载请联系作者并注明出处：https://m.elefans.com/xitong/1727246344a1104672.html， 本站仅提供信息存储空间服务，不拥有所有权，不承担相关法律责任。如发现本站有涉嫌抄袭侵权/违法违规的内容，一经查实，本站将立刻删除。