Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Training ImageNet models #67

Open
kiwen-lee opened this issue Jul 3, 2021 · 0 comments
Open

Training ImageNet models #67

kiwen-lee opened this issue Jul 3, 2021 · 0 comments

Comments

@kiwen-lee
Copy link

kiwen-lee commented Jul 3, 2021

CUDA_VISIBLE_DEVICES=6 python -B supervised.py --imagenet_data='/data/imagenet/tf_records/train/' 
--model_dir='/home/fixmatch-master/models/supervised' 
--steps_per_run=100 
--dataset="imagenet" 
--hparams="\"bfloat16\": false, \"num_epochs\": 200, \"augment\": { \"type\": \"cta\" }"

The error:

2021-07-04 21:12:57.888177: W tensorflow/stream_executor/platform/default/dso_loader.cc:55] Could not load dynamic library 'libnvinfer.so.6'; dlerror: libnvinfer.so.6: cannot open shared object file: No such file or directory
2021-07-04 21:12:57.888288: W tensorflow/stream_executor/platform/default/dso_loader.cc:55] Could not load dynamic library 'libnvinfer_plugin.so.6'; dlerror: libnvinfer_plugin.so.6: cannot open shared object file: No such file or directory
2021-07-04 21:12:57.888303: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:30] Cannot dlopen some TensorRT libraries. If you would like to use Nvidia GPU with TensorRT, please make sure the missing libraries mentioned above are installed properly.
Traceback (most recent call last):
  File "supervised.py", line 20, in <module>
    import tensorflow as tf
  File "/home/anaconda3/envs/tf2/lib/python3.7/site-packages/tensorflow/__init__.py", line 101, in <module>
    from tensorflow_core import *
  File "/home/anaconda3/envs/tf2/lib/python3.7/site-packages/tensorflow_core/__init__.py", line 40, in <module>
    from tensorflow.python.tools import module_util as _module_util
  File "<frozen importlib._bootstrap>", line 983, in _find_and_load
  File "<frozen importlib._bootstrap>", line 959, in _find_and_load_unlocked
  File "/home/anaconda3/envs/tf2/lib/python3.7/site-packages/tensorflow/__init__.py", line 50, in __getattr__
    module = self._load()
  File "/home/anaconda3/envs/tf2/lib/python3.7/site-packages/tensorflow/__init__.py", line 44, in _load
    module = _importlib.import_module(self.__name__)
  File "/home/anaconda3/envs/tf2/lib/python3.7/importlib/__init__.py", line 127, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "/home/anaconda3/envs/tf2/lib/python3.7/site-packages/tensorflow_core/python/__init__.py", line 95, in <module>
    from tensorflow.python import keras
  File "/home/anaconda3/envs/tf2/lib/python3.7/site-packages/tensorflow_core/python/keras/__init__.py", line 27, in <module>
    from tensorflow.python.keras import models
  File "/home/anaconda3/envs/tf2/lib/python3.7/site-packages/tensorflow_core/python/keras/__init__.py", line 27, in <module>
    from tensorflow.python.keras import models
  File "/home/anaconda3/envs/tf2/lib/python3.7/site-packages/tensorflow_core/python/keras/models.py", line 26, in <module>
    from tensorflow.python.keras.engine import sequential
  File "/home/anaconda3/envs/tf2/lib/python3.7/site-packages/tensorflow_core/python/keras/engine/sequential.py", line 28, in <module>
    from tensorflow.python.keras.engine import training
  File "/home/anaconda3/envs/tf2/lib/python3.7/site-packages/tensorflow_core/python/keras/engine/training.py", line 51, in <module>
    from tensorflow.python.keras.engine import training_v2
  File "/home/anaconda3/envs/tf2/lib/python3.7/site-packages/tensorflow_core/python/keras/engine/training_v2.py", line 35, in <module>
    from tensorflow.python.keras.engine import data_adapter
  File "/home/anaconda3/envs/tf2/lib/python3.7/site-packages/tensorflow_core/python/keras/engine/data_adapter.py", line 50, in <module>
    import pandas as pd  # pylint: disable=g-import-not-at-top
  File "/home/anaconda3/envs/tf2/lib/python3.7/site-packages/pandas/__init__.py", line 29, in <module>
    from pandas._libs import hashtable as _hashtable, lib as _lib, tslib as _tslib
  File "/home/anaconda3/envs/tf2/lib/python3.7/site-packages/pandas/_libs/__init__.py", line 13, in <module>
    from pandas._libs.interval import Interval
  File "pandas/_libs/interval.pyx", line 1, in init pandas._libs.interval
ValueError: numpy.ndarray size changed, may indicate binary incompatibility. Expected 88 from C header, got 80 from PyObject
Package                 Version
----------------------- -------------------
absl-py                 0.13.0
aiohttp                 3.7.4
apache-beam             2.30.0
astor                   0.8.1
astunparse              1.6.3
async-timeout           3.0.1
attrs                   21.2.0
avro-python3            1.9.2.1
backcall                0.2.0
blinker                 1.4
brotlipy                0.7.0
cached-property         1.5.2
cachetools              4.2.2
certifi                 2021.5.30
cffi                    1.14.5
chardet                 3.0.4
click                   8.0.1
coverage                5.5
crcmod                  1.7
cryptography            3.4.7
cycler                  0.10.0
Cython                  0.29.23
dill                    0.3.1.1
docopt                  0.6.2
easydict                1.9
fastavro                1.4.2
flatbuffers             1.12
future                  0.18.2
gast                    0.2.2
google-auth             1.32.0
google-auth-oauthlib    0.4.4
google-pasta            0.2.0
grpcio                  1.32.0
h5py                    2.10.0
hdfs                    2.6.0
httplib2                0.19.1
idna                    2.10
importlib-metadata      3.10.0
ipython                 7.17.0
ipython-genutils        0.2.0
jedi                    0.17.2
Keras-Applications      1.0.8
Keras-Preprocessing     1.1.0
kiwisolver              1.3.1
Markdown                3.3.4
matplotlib              3.4.2
mkl-fft                 1.3.0
mkl-random              1.2.1
mkl-service             2.3.0
multidict               5.1.0
numpy                   1.18.5
oauth2client            4.1.3
oauthlib                3.1.0
opt-einsum              3.3.0
pandas                  1.2.5
parso                   0.7.1
pexpect                 4.8.0
pickleshare             0.7.5
Pillow                  8.3.0
pip                     21.1.3
prompt-toolkit          3.0.6
protobuf                3.15.8
ptyprocess              0.6.0
pyarrow                 3.0.0
pyasn1                  0.4.8
pyasn1-modules          0.2.8
pycocotools             2.0.1
pycparser               2.20
pydot                   1.2.4
Pygments                2.6.1
PyJWT                   1.7.1
pykerberos              1.2.1
pymongo                 3.11.4
pyOpenSSL               20.0.1
pyparsing               2.4.7
PySocks                 1.7.1
python-dateutil         2.8.1
python-snappy           0.6.0
pytz                    2021.1
requests                2.25.1
requests-kerberos       0.12.0
requests-oauthlib       1.3.0
rsa                     4.7.2
scipy                   1.4.1
setuptools              52.0.0.post20210125
six                     1.15.0
tensorboard             2.1.1
tensorboard-data-server 0.6.1
tensorboard-plugin-wit  1.6.0
tensorflow              2.1.0
tensorflow-addons       0.9.1
tensorflow-estimator    2.1.0
tensorflow-gpu          2.1.4
termcolor               1.1.0
typeguard               2.12.1
typing-extensions       3.7.4.1
urllib3                 1.26.6
wcwidth                 0.2.5
Werkzeug                1.0.1
wheel                   0.36.2
wrapt                   1.12.1
yarl                    1.6.3
zipp                    3.4.1
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant