--

hello Sascha. I have a similar requirement but my requirement is to read data from a big query table and create csv files. I am also using cloud data flow. For us also the data would be of size from hundreds of MB to GB. Which means we need to create csv files for around 20 million records read from big query. Just wanted your inputs. I haven't been able to create this data scenario in dev.

Sign up to discover human stories that deepen your understanding of the world.

Free

Distraction-free reading. No ads.

Organize your knowledge with lists and highlights.

Tell your story. Find your audience.

Membership

Read member-only stories

Support writers you read most

Earn money for your writing

Listen to audio narrations

Read offline with the Medium app

--

--

Responses (1)

Write a response