google-research / google-research/task_adaptation

Minimal working notebook on Google Colab

Open
#15 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
352
Forks
37
PR merge metrics
No merged PRs in 30d

Description

I'm failing to run a super simple experiment with `adapt_and_eval.py` on Google Colab. I can partially run the notebook in #13, but when it comes to `I0102 07:15:12.329720 139875900389248 dataset_builder.py:342] Reusing dataset cifar100 (/root/tensorflow_datasets/cifar100/3.0.2)` it crashes with the following error:

> INFO:tensorflow:Using config: {'_model_dir': '/tmp/cifar100', '_tf_random_seed': None, '_save_summary_steps': 100, '_save_checkpoints_steps': 500, '_save_checkpoints_secs': None, '_session_config': allow_soft_placement: true
graph_options {
rewrite_options {
meta_optimizer_iterations: ONE
}
}
, '_keep_checkpoint_max': None, '_keep_checkpoint_every_n_hours': 10000, '_log_step_count_steps': 100, '_train_distribute': None, '_device_fn': None, '_protocol': None, '_eval_distribute': None, '_experimental_distribute': None, '_experimental_max_worker_delay_secs': None, '_session_creation_timeout_secs': 7200, '_checkpoint_save_graph_def': True, '_service': None, '_cluster_spec': ClusterSpec({}), '_task_type': 'worker', '_task_id': 0, '_global_id_in_cluster': 0, '_master': '', '_evaluation_master': '', '_is_chief': True, '_num_ps_replicas': 0, '_num_worker_replicas': 1}
I0102 07:15:12.333971 139875900389248 estimator.py:191] Using config: {'_model_dir': '/tmp/cifar100', '_tf_random_seed': None, '_save_summary_steps': 100, '_save_checkpoints_steps': 500, '_save_checkpoints_secs': None, '_session_config': allow_soft_placement: true
graph_options {
rewrite_options {
meta_optimizer_iterations: ONE
}
}
, '_keep_checkpoint_max': None, '_keep_checkpoint_every_n_hours': 10000, '_log_step_count_steps': 100, '_train_distribute': None, '_device_fn': None, '_protocol': None, '_eval_distribute': None, '_experimental_distribute': None, '_experimental_max_worker_delay_secs': None, '_session_creation_timeout_secs': 7200, '_checkpoint_save_graph_def': True, '_service': None, '_cluster_spec': ClusterSpec({}), '_task_type': 'worker', '_task_id': 0, '_global_id_in_cluster': 0, '_master': '', '_evaluation_master': '', '_is_chief': True, '_num_ps_replicas': 0, '_num_worker_replicas': 1}
Traceback (most recent call last):
File "/usr/local/bin/adapt_and_eval.py", line 7, in
exec(compile(f.read(), __file__, 'exec'))
File "/content/task_adaptation/task_adaptation/adapt_and_eval.py", line 150, in
app.run(main)
File "/usr/local/lib/python3.6/dist-packages/absl/app.py", line 300, in run
_run_main(main, args)
File "/usr/local/lib/python3.6/dist-packages/absl/app.py", line 251, in _run_main
sys.exit(main(argv))
File "/content/task_adaptation/task_adaptation/adapt_and_eval.py", line 146, in main
data_params=get_data_params_from_flags("evaluation"))
File "/content/task_adaptation/task_adaptation/loop.py", line 133, in run_evaluation_loop
data_params)
File "/content/task_adaptation/task_adaptation/loop.py", line 91, in setup_estimator
config=config)
File "/usr/local/lib/python3.6/dist-packages/tensorflow_estimator/python/estimator/estimator.py", line 200, in __init__
self._params = copy.deepcopy(params or {})
File "/usr/lib/python3.6/copy.py", line 150, in deepcopy
y = copier(x, memo)
File "/usr/lib/python3.6/copy.py", line 240, in _deepcopy_dict
y[deepcopy(key, memo)] = deepcopy(value, memo)
File "/usr/lib/python3.6/copy.py", line 180, in deepcopy
y = _reconstruct(x, memo, *rv)
File "/usr/lib/python3.6/copy.py", line 280, in _reconstruct
state = deepcopy(state, memo)
File "/usr/lib/python3.6/copy.py", line 150, in deepcopy
y = copier(x, memo)
File "/usr/lib/python3.6/copy.py", line 240, in _deepcopy_dict
y[deepcopy(key, memo)] = deepcopy(value, memo)
File "/usr/lib/python3.6/copy.py", line 180, in deepcopy
y = _reconstruct(x, memo, *rv)
File "/usr/lib/python3.6/copy.py", line 282, in _reconstruct
y.__setstate__(state)
File "/usr/local/lib/python3.6/dist-packages/tensorflow_datasets/core/dataset_builder.py", line 216, in __setstate__
self.__init__(**state)
TypeError: __init__() got an unexpected keyword argument 'data_dir'

Is it possible to add some working tutorials for VTAB on TF2?
Thanks

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.