Code

Bring back GCS ops.#1229

Code

Open

michaelbanfield wants to merge 85 commits intotensorflow:mastertensorflow/io:masterfrom michaelbanfield:mastermichaelbanfield/io:masterCopy head branch name to clipboard

+6,631-12,845

Commits

Commits on Dec 15, 2020

• Add a standalone binary build for GCS ops

  michaelbanfield

  committed
  59ddbc4

  Copy full SHA for 59ddbc4

• Revert "Deprecate gcs-config (tensorflow#1024)"

  Show description for ca8e327
  michaelbanfield

  committed
  ca8e327

  Copy full SHA for ca8e327

• Rebase change

  michaelbanfield

  committed
  cb8ffe7

  Copy full SHA for cb8ffe7

• Clean up merge

  michaelbanfield

  committed
  3536338

  Copy full SHA for 3536338

• Fix lint errors

  michaelbanfield

  committed
  11c8a51

  Copy full SHA for 11c8a51

Commits on Mar 29, 2021

• Skip tests for windows

  michaelbanfield

  committed
  3560ac6

  Copy full SHA for 3560ac6

• Move build target to exclude windows

  michaelbanfield

  committed
  42c2867

  Copy full SHA for 42c2867

Commits on Mar 30, 2021

• Update the API Compatibility test to include tf-nightly vs. tensorflow-io==0.17.0 (tensorflow#1230)

  Show description for 7c04ee3
  

  yongtang

  authored and

  michaelbanfield

  committed
  7c04ee3

  Copy full SHA for 7c04ee3

• Bump Apache Arrow to 2.0.0 (tensorflow#1231)

  Show description for 760dd25
  

  yongtang

  authored and

  michaelbanfield

  committed
  760dd25

  Copy full SHA for 760dd25

• Bump Avro to 1.10.1 (tensorflow#1235)

  Show description for 9a3663c
  

  yongtang

  authored and

  michaelbanfield

  committed
  9a3663c

  Copy full SHA for 9a3663c

• Add emulator for gcs (tensorflow#1234)

  Show description for 2e6936f
  

  vnghia

  authored and

  michaelbanfield

  committed
  2e6936f

  Copy full SHA for 2e6936f

• fix nightly build because of missing google-cloud-storage (tensorflow#1238)

  

  vnghia

  authored and

  michaelbanfield

  committed
  04d6913

  Copy full SHA for 04d6913

• Remove the CI build for CentOS 8 (tensorflow#1237)

  Show description for aa1a95d
  

  yongtang

  authored and

  michaelbanfield

  committed
  aa1a95d

  Copy full SHA for aa1a95d

• [MongoDB] update API docstrings (tensorflow#1243)

  Show description for 6c29813
  

  kvignesh1420

  authored and

  michaelbanfield

  committed
  6c29813

  Copy full SHA for 6c29813

• Remove redundant output of dataset.element_spec in PostgreSQL tutorial (tensorflow#1242)

  

  terrytangyuan

  authored and

  michaelbanfield

  committed
  371877e

  Copy full SHA for 371877e

• add tf-c-header rule (tensorflow#1244)

  

  vnghia

  authored and

  michaelbanfield

  committed
  88b9d8d

  Copy full SHA for 88b9d8d

• Add fail-fast: false to API Compatibility GitHub Actions (tensorflow#1246)

  Show description for d695644
  

  yongtang

  authored and

  michaelbanfield

  committed
  d695644

  Copy full SHA for d695644

• Skip tf-nightly:tensorflow-io==0.17.0 on API compatibility test (tensorflow#1247)

  Show description for b0ffa2e
  

  yongtang

  authored and

  michaelbanfield

  committed
  b0ffa2e

  Copy full SHA for b0ffa2e

• S3 Improvements (tensorflow#1248)

  Show description for a68633e
  

  vnghia

  authored and

  michaelbanfield

  committed
  a68633e

  Copy full SHA for a68633e

• Add missed function RecursivelyCreateDir for hdfs file system implementation (tensorflow#1218)

  Show description for e29e8a3
  

  yongtang

  authored and

  michaelbanfield

  committed
  e29e8a3

  Copy full SHA for e29e8a3

• update bazel version to 3.7.2 (tensorflow#1251)

  

  kvignesh1420

  authored and

  michaelbanfield

  committed
  fd7bc1a

  Copy full SHA for fd7bc1a

• [audio] cleanup vorbis file after usage (tensorflow#1249)

  Show description for 7bb3d30
  

  kvignesh1420

  authored and

  michaelbanfield

  committed
  7bb3d30

  Copy full SHA for 7bb3d30

• [s3] add support for testing on macOS (tensorflow#1253)

  Show description for 9966944
  

  kvignesh1420

  authored and

  michaelbanfield

  committed
  9966944

  Copy full SHA for 9966944

• add notebook formatting instruction in README (tensorflow#1256)

  

  burgerkingeater

  authored and

  michaelbanfield

  committed
  0342a16

  Copy full SHA for 0342a16

• [docs] Restructure README.md content (tensorflow#1257)

  Show description for b56ad5d
  

  kvignesh1420

  authored and

  michaelbanfield

  committed
  b56ad5d

  Copy full SHA for b56ad5d

• Update libtiff/libgeotiff dependency (tensorflow#1258)

  Show description for ab9004d
  

  yongtang

  authored and

  michaelbanfield

  committed
  ab9004d

  Copy full SHA for ab9004d

• Update openjpeg to 2.4.0 (tensorflow#1259)

  Show description for 0381b91
  

  yongtang

  authored and

  michaelbanfield

  committed
  0381b91

  Copy full SHA for 0381b91

• [arrow] using eager exec for examples in README.md (tensorflow#1261)

  

  kvignesh1420

  authored and

  michaelbanfield

  committed
  ac8da58

  Copy full SHA for ac8da58

• remove unstable elasticsearch test setup on macOS (tensorflow#1263)

  

  kvignesh1420

  authored and

  michaelbanfield

  committed
  3641d2a

  Copy full SHA for 3641d2a

• Exposes num_parallel_reads and num_parallel_calls (tensorflow#1232)

  Show description for 4f340e0
  

  2 peopleauthored and

  michaelbanfield

  committed
  4f340e0

  Copy full SHA for 4f340e0

• Fix incomplete row reading issue in parquet files (tensorflow#1262)

  Show description for 0663d38
  

  yongtang

  authored and

  michaelbanfield

  committed
  0663d38

  Copy full SHA for 0663d38

• Tests to train a keras model using MongoDBIODataset (tensorflow#1264)

  

  kvignesh1420

  authored and

  michaelbanfield

  committed
  7cb6b0f

  Copy full SHA for 7cb6b0f

• add avro tutorial testing data (tensorflow#1267)

  Show description for cebc613
  

  burgerkingeater

  authored and

  michaelbanfield

  committed
  cebc613

  Copy full SHA for cebc613

• Update Kafka tutorial to work with Apache Kafka (tensorflow#1266)

  Show description for fc8d472
  

  dalelane

  authored and

  michaelbanfield

  committed
  fc8d472

  Copy full SHA for fc8d472

• Update pulsar download link. (tensorflow#1270)

  Show description for 5df32c6
  

  yongtang

  authored and

  michaelbanfield

  committed
  5df32c6

  Copy full SHA for 5df32c6

• add github workflow for performance benchmarking (tensorflow#1269)

  Show description for 2bbdd40
  

  kvignesh1420

  authored and

  michaelbanfield

  committed
  2bbdd40

  Copy full SHA for 2bbdd40

• handle missing dependencies while benchmarking (tensorflow#1271)

  Show description for f8efb10
  

  kvignesh1420

  authored and

  michaelbanfield

  committed
  f8efb10

  Copy full SHA for f8efb10

• Disable s3 macOS for now as docker is not working on GitHub Actions for macOS (tensorflow#1277)

  Show description for 544740a
  

  yongtang

  authored and

  michaelbanfield

  committed
  544740a

  Copy full SHA for 544740a

• rename testing data files (tensorflow#1278)

  

  burgerkingeater

  authored and

  michaelbanfield

  committed
  b71fcb3

  Copy full SHA for b71fcb3

• Add tutorial for avro dataset API (tensorflow#1250)

  

  burgerkingeater

  authored and

  michaelbanfield

  committed
  337ef96

  Copy full SHA for 337ef96

• remove docker based mongodb tests in macos (tensorflow#1279)

  

  kvignesh1420

  authored and

  michaelbanfield

  committed
  c0d56ee

  Copy full SHA for c0d56ee

• trigger benchmarks workflow only on commits (tensorflow#1282)

  

  kvignesh1420

  authored and

  michaelbanfield

  committed
  f16c613

  Copy full SHA for f16c613

• Bump Apache Arrow to 3.0.0 (tensorflow#1285)

  Show description for ef2927c
  

  yongtang

  authored and

  michaelbanfield

  committed
  ef2927c

  Copy full SHA for ef2927c

• Add bazel cache (tensorflow#1287)

  Show description for 03b77de
  

  yongtang

  authored and

  michaelbanfield

  committed
  03b77de

  Copy full SHA for 03b77de

• Add initial bigtable stub test (tensorflow#1286)

  Show description for f492bc8
  

  yongtang

  authored and

  michaelbanfield

  committed
  f492bc8

  Copy full SHA for f492bc8

• Update azure lite v0.3.0 (tensorflow#1288)

  Show description for 2808ac3
  

  yongtang

  authored and

  michaelbanfield

  committed
  2808ac3

  Copy full SHA for 2808ac3

• Add reference to github-pages benchmarks in README (tensorflow#1289)

  Show description for 5a42d1e
  

  2 peopleauthored and

  michaelbanfield

  committed
  5a42d1e

  Copy full SHA for 5a42d1e

• Update _toc.yaml (tensorflow#1290)

  

  burgerkingeater

  authored and

  michaelbanfield

  committed
  ff6245a

  Copy full SHA for ff6245a

• Clear outputs (tensorflow#1292)

  

  MarkDaoust

  authored and

  michaelbanfield

  committed
  8a1fead

  Copy full SHA for 8a1fead

• fix kafka online-learning section in tutorial notebook (tensorflow#1274)

  Show description for b07d1ab
  

  kvignesh1420

  authored and

  michaelbanfield

  committed
  b07d1ab

  Copy full SHA for b07d1ab

• Only enable bazel caching writes for tensorflow/io github actions (tensorflow#1293)

  Show description for 5299d14
  

  yongtang

  authored and

  michaelbanfield

  committed
  5299d14

  Copy full SHA for 5299d14

• Enable ready-only bazel cache (tensorflow#1294)

  Show description for f02af15
  

  yongtang

  authored and

  michaelbanfield

  committed
  f02af15

  Copy full SHA for f02af15

• Update xz to 5.2.5, and switch the download link. (tensorflow#1296)

  Show description for 84bba4c
  

  yongtang

  authored and

  michaelbanfield

  committed
  84bba4c

  Copy full SHA for 84bba4c

• Enable bazel remote cache for kokoro tests (tensorflow#1295)

  

  yongtang

  authored and

  michaelbanfield

  committed
  0a7c5a2

  Copy full SHA for 0a7c5a2

• Rename tests (tensorflow#1297)

  

  yongtang

  authored and

  michaelbanfield

  committed
  880c8b3

  Copy full SHA for 880c8b3

• Combine Ubuntu 20.04 and CentOS 7 tests into one GitHub jobs (tensorflow#1299)

  Show description for 7010a48
  

  yongtang

  authored and

  michaelbanfield

  committed
  7010a48

  Copy full SHA for 7010a48

• Update names of api tests (tensorflow#1300)

  Show description for 5091b94
  

  yongtang

  authored and

  michaelbanfield

  committed
  5091b94

  Copy full SHA for 5091b94

• Fix wrong benchmark tests names (tensorflow#1301)

  Show description for 79ccf5e
  

  yongtang

  authored and

  michaelbanfield

  committed
  79ccf5e

  Copy full SHA for 79ccf5e

• Patch arrow to temporarily resolve the ARROW-11518 issue (tensorflow#1304)

  Show description for 7945ec5
  

  yongtang

  authored and

  michaelbanfield

  committed
  7945ec5

  Copy full SHA for 7945ec5

• Avoid error if plugins .so module is not available (tensorflow#1302)

  Show description for a398d26
  

  yongtang

  authored and

  michaelbanfield

  committed
  a398d26

  Copy full SHA for a398d26

• Remove AWS headers from tensorflow, and use headers from third_party … (tensorflow#1241)

  Show description for df04e37
  

  yongtang

  authored and

  michaelbanfield

  committed
  df04e37

  Copy full SHA for df04e37

• Fix docstring. (tensorflow#1305)

  Show description for cc93afa
  

  MarkDaoust

  authored and

  michaelbanfield

  committed
  cc93afa

  Copy full SHA for cc93afa

• Switch to use github to download libgeotiff (tensorflow#1307)

  Show description for f34d193
  

  yongtang

  authored and

  michaelbanfield

  committed
  f34d193

  Copy full SHA for f34d193

• Add @com_google_absl//absl/strings:cord (tensorflow#1308)

  Show description for 801569f
  

  yongtang

  authored and

  michaelbanfield

  committed
  801569f

  Copy full SHA for 801569f

• Switch to modular file system for hdfs (tensorflow#1309)

  Show description for a871e52
  

  yongtang

  authored and

  michaelbanfield

  committed
  a871e52

  Copy full SHA for a871e52

• Disable test_write_kafka test for now. (tensorflow#1310)

  Show description for 5b77f96
  

  yongtang

  authored and

  michaelbanfield

  committed
  5b77f96

  Copy full SHA for 5b77f96

• Modify --plat-name for macosx wheels (tensorflow#1311)

  Show description for 53c9a71
  

  kvignesh1420

  authored and

  michaelbanfield

  committed
  53c9a71

  Copy full SHA for 53c9a71

• Switch to modular file system for s3 (tensorflow#1312)

  Show description for 3f7f292
  

  yongtang

  authored and

  michaelbanfield

  committed
  3f7f292

  Copy full SHA for 3f7f292

• Update to enable python 3.9 building on Linux (tensorflow#1314)

  Show description for 33fca56
  

  yongtang

  authored and

  michaelbanfield

  committed
  33fca56

  Copy full SHA for 33fca56

• Add python 3.9 on Windows (tensorflow#1316)

  

  yongtang

  authored and

  michaelbanfield

  committed
  314f406

  Copy full SHA for 314f406

• Use -p 9000:9000 (and hide 8088) when launch hadoop (tensorflow#1317)

  

  yongtang

  authored and

  michaelbanfield

  committed
  fb5cab8

  Copy full SHA for fb5cab8

• Experimental: Add initial wavefront/obj parser for vertices (tensorflow#1315)

  Show description for 221e221
  

  yongtang

  authored and

  michaelbanfield

  committed
  221e221

  Copy full SHA for 221e221

• update protobuf version to 3.11.4 to match tensorflow-nightly (tensorflow#1320)

  

  vnghia

  authored and

  michaelbanfield

  committed
  3b81b85

  Copy full SHA for 3b81b85

• Revert "update protobuf version to 3.11.4 to match tensorflow-nightly (tensorflow#1320)" (tensorflow#1323)

  Show description for 1c85b77
  

  vnghia

  authored and

  michaelbanfield

  committed
  1c85b77

  Copy full SHA for 1c85b77

• Enable python 3.9 build on macOS (tensorflow#1324)

  Show description for ef46f8c
  

  yongtang

  authored and

  michaelbanfield

  committed
  ef46f8c

  Copy full SHA for ef46f8c

• switch mnist dataset mirror to a more reliable one (tensorflow#1327)

  

  vnghia

  authored and

  michaelbanfield

  committed
  3121308

  Copy full SHA for 3121308

• remove flaky centos 7 based build action (tensorflow#1328)

  

  kvignesh1420

  authored and

  michaelbanfield

  committed
  57d840b

  Copy full SHA for 57d840b

• Adds AVRO_PARSER_NUM_MINIBATCH to override num_minibatches and logs the parsing time (tensorflow#1283)

  Show description for c7e99a5
  

  9 peopleauthored and

  michaelbanfield

  committed
  c7e99a5

  Copy full SHA for c7e99a5

• Super Serial- automatically save and load TFRecords from Tensorflow datasets (tensorflow#1280)

  Show description for de54c3c
  

  markemus

  authored and

  michaelbanfield

  committed
  de54c3c

  Copy full SHA for de54c3c

• Fix link in avro reader notebook (tensorflow#1333)

  Show description for 9644be3
  

  oliverhu

  authored and

  michaelbanfield

  committed
  9644be3

  Copy full SHA for 9644be3

• Bump abseil-cpp to 6f9d96a1f41439ac172ee2ef7ccd8edf0e5d068c (tensorflow#1336)

  Show description for 8d7d28f
  

  yongtang

  authored and

  michaelbanfield

  committed
  8d7d28f

  Copy full SHA for 8d7d28f

• Release nightly even if test fails (tensorflow#1339)

  Show description for 3de431d
  

  yongtang

  authored and

  michaelbanfield

  committed
  3de431d

  Copy full SHA for 3de431d

• remove unused/stale azure_ops (tensorflow#1338)

  

  kvignesh1420

  authored and

  michaelbanfield

  committed
  ef8a5d5

  Copy full SHA for ef8a5d5

• gcs switch to env (tensorflow#1319)

  Show description for 4154a2c
  

  vnghia

  authored and

  michaelbanfield

  committed
  4154a2c

  Copy full SHA for 4154a2c

• improvements for s3 environements variables (tensorflow#1343)

  Show description for 64eb761
  

  vnghia

  authored and

  michaelbanfield

  committed
  64eb761

  Copy full SHA for 64eb761