Skip to content

NotImplementedError: unable to open file: libtensorflow_io.so #2139

@suyttthideptrai

Description

@suyttthideptrai

I got NotImplementedError when calling tfio.audio.resample(wav, rate_in=sample_rate, rate_out=16000)

Based on TensorFlow Version Compatibility table at https://github.com/tensorflow/io/README.md, I have configured tensorflow packages as follow
$ conda list tensorflow

# packages in environment at /opt/conda/envs/sra-env:
#
# Name                    Version                   Build  Channel
tensorflow                2.16.2          cpu_py312h69ecde4_0    conda-forge
tensorflow-base           2.16.2          cpu_py312h5c1443c_0    conda-forge
tensorflow-estimator      2.16.2          cpu_py312hbf2973a_0    conda-forge
tensorflow-hub            0.16.1             pyhd8ed1ab_3    conda-forge
tensorflow-io             0.37.1                   pypi_0    pypi
tensorflow-io-gcs-filesystem 0.37.1                   pypi_0    pypi

Python version:
$ conda list python

# packages in environment at /opt/conda/envs/sra-env:
#
# Name                    Version                   Build  Channel
python                    3.12.9          h9e4cc4f_1_cpython    conda-forge
...

For the dev environment, I'm using this image: "mcr.microsoft.com/devcontainers/miniconda:1-3"

PRETTY_NAME="Debian GNU/Linux 12 (bookworm)"
NAME="Debian GNU/Linux"
VERSION_ID="12"
VERSION="12 (bookworm)"
VERSION_CODENAME=bookworm
ID=debian

Full stacktrace:

2025-03-24 07:14:42.426934: I tensorflow/core/platform/cpu_feature_guard.cc:210] This TensorFlow binary is optimized to use available CPU instructions in performance-critical operations.
To enable the following instructions: SSE4.1 SSE4.2 AVX AVX2 FMA, in other operations, rebuild TensorFlow with the appropriate compiler flags.
(640, 8)
WARNING:tensorflow:AutoGraph could not transform <function resample at 0x7f8a497571a0> and will run it as-is.
Please report this to the TensorFlow team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output.
Cause: unable to open file: libtensorflow_io.so, from paths: ['/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow_io/python/ops/libtensorflow_io.so']
caused by: ['/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow_io/python/ops/libtensorflow_io.so: undefined symbol: _ZNK10tensorflow4data11DatasetBase8FinalizeEPNS_15OpKernelContextESt8functionIFN4absl12lts_202308028StatusOrIN3tsl4core11RefCountPtrIS1_EEEEvEE']
To silence this warning, decorate the function with @tf.autograph.experimental.do_not_convert
WARNING | AutoGraph could not transform <function resample at 0x7f8a497571a0> and will run it as-is.
Please report this to the TensorFlow team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output.
Cause: unable to open file: libtensorflow_io.so, from paths: ['/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow_io/python/ops/libtensorflow_io.so']
caused by: ['/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow_io/python/ops/libtensorflow_io.so: undefined symbol: _ZNK10tensorflow4data11DatasetBase8FinalizeEPNS_15OpKernelContextESt8functionIFN4absl12lts_202308028StatusOrIN3tsl4core11RefCountPtrIS1_EEEEvEE']
To silence this warning, decorate the function with @tf.autograph.experimental.do_not_convert
Traceback (most recent call last):
  File "/workspaces/sound-recognition-ai/python/test.py", line 9, in <module>
    ds_ts = to_tensor_dataset(df)
            ^^^^^^^^^^^^^^^^^^^^^
  File "/workspaces/sound-recognition-ai/python/utils/dframe_utils.py", line 74, in to_tensor_dataset
    return ts_ds.map(transform_wav)
           ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow/python/data/ops/dataset_ops.py", line 2299, in map
    return map_op._map_v2(
           ^^^^^^^^^^^^^^^
  File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow/python/data/ops/map_op.py", line 37, in _map_v2
    return _MapDataset(
           ^^^^^^^^^^^^
  File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow/python/data/ops/map_op.py", line 107, in __init__
    self._map_func = structured_function.StructuredFunctionWrapper(
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow/python/data/ops/structured_function.py", line 265, in __init__
    self._function = fn_factory()
                     ^^^^^^^^^^^^
  File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow/python/eager/polymorphic_function/polymorphic_function.py", line 1251, in get_concrete_function
    concrete = self._get_concrete_function_garbage_collected(*args, **kwargs)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow/python/eager/polymorphic_function/polymorphic_function.py", line 1221, in _get_concrete_function_garbage_collected
    self._initialize(args, kwargs, add_initializers_to=initializers)
  File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow/python/eager/polymorphic_function/polymorphic_function.py", line 696, in _initialize
    self._concrete_variable_creation_fn = tracing_compilation.trace_function(
                                          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow/python/eager/polymorphic_function/tracing_compilation.py", line 178, in trace_function
    concrete_function = _maybe_define_function(
                        ^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow/python/eager/polymorphic_function/tracing_compilation.py", line 283, in _maybe_define_function
    concrete_function = _create_concrete_function(
                        ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow/python/eager/polymorphic_function/tracing_compilation.py", line 310, in _create_concrete_function
    traced_func_graph = func_graph_module.func_graph_from_py_func(
                        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow/python/framework/func_graph.py", line 1059, in func_graph_from_py_func
    func_outputs = python_func(*func_args, **func_kwargs)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow/python/eager/polymorphic_function/polymorphic_function.py", line 599, in wrapped_fn
    out = weak_wrapped_fn().__wrapped__(*args, **kwds)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow/python/data/ops/structured_function.py", line 231, in wrapped_fn
    ret = wrapper_helper(*args)
          ^^^^^^^^^^^^^^^^^^^^^
  File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow/python/data/ops/structured_function.py", line 161, in wrapper_helper
    ret = autograph.tf_convert(self._func, ag_ctx)(*nested_args)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow/python/autograph/impl/api.py", line 693, in wrapper
    raise e.ag_error_metadata.to_exception(e)
  File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow/python/autograph/impl/api.py", line 690, in wrapper
    return converted_call(f, args, kwargs, options=options)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow/python/autograph/impl/api.py", line 439, in converted_call
    result = converted_f(*effective_args, **kwargs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/tmp/__autograph_generated_filejvnwf2jf.py", line 13, in tf__transform_wav
    retval_ = (ag__.converted_call(ag__.ld(load_wav_16k_mono), (ag__.ld(filename),), None, fscope), ag__.ld(class_id), ag__.ld(fold))
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow/python/autograph/impl/api.py", line 377, in converted_call
    return _call_unconverted(f, args, kwargs, options)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow/python/autograph/impl/api.py", line 460, in _call_unconverted
    return f(*args)
           ^^^^^^^^
  File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow/python/util/traceback_utils.py", line 153, in error_handler
    raise e.with_traceback(filtered_tb) from None
  File "/tmp/__autograph_generated_filejidpphe2.py", line 15, in tf__load_wav_16k_mono
    wav = ag__.converted_call(ag__.ld(tfio).audio.resample, (ag__.ld(wav),), dict(rate_in=ag__.ld(sample_rate), rate_out=16000), fscope)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow_io/python/ops/audio_ops.py", line 469, in resample
    value = tf.vectorized_map(f, input)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow_io/python/ops/audio_ops.py", line 465, in f
    return core_ops.io_audio_resample(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow_io/python/ops/__init__.py", line 88, in __getattr__
    return getattr(self._load(), attrb)
                   ^^^^^^^^^^^^
  File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow_io/python/ops/__init__.py", line 84, in _load
    self._mod = _load_library(self._library)
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow_io/python/ops/__init__.py", line 69, in _load_library
    raise NotImplementedError(
NotImplementedError: in user code:

    File "/workspaces/sound-recognition-ai/python/utils/dframe_utils.py", line 67, in transform_wav  *
        return load_wav_16k_mono(filename), class_id, fold
    File "/workspaces/sound-recognition-ai/python/utils/wav_utils.py", line 59, in load_wav_16k_mono  *
        wav = tfio.audio.resample(wav, rate_in=sample_rate, rate_out=16000)
    File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow_io/python/ops/audio_ops.py", line 469, in resample  **
        value = tf.vectorized_map(f, input)
    File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow_io/python/ops/audio_ops.py", line 465, in f
        return core_ops.io_audio_resample(
    File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow_io/python/ops/__init__.py", line 88, in __getattr__
        return getattr(self._load(), attrb)
    File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow_io/python/ops/__init__.py", line 84, in _load
        self._mod = _load_library(self._library)
    File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow_io/python/ops/__init__.py", line 69, in _load_library
        raise NotImplementedError(

    NotImplementedError: unable to open file: libtensorflow_io.so, from paths: ['/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow_io/python/ops/libtensorflow_io.so']
    caused by: ['/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow_io/python/ops/libtensorflow_io.so: undefined symbol: _ZNK10tensorflow4data11DatasetBase8FinalizeEPNS_15OpKernelContextESt8functionIFN4absl12lts_202308028StatusOrIN3tsl4core11RefCountPtrIS1_EEEEvEE']

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions