Streaming pipeline example from GCS via Cloud Functions to BigQuery

https://cloud.google.com/architecture/streaming-data-from-cloud-storage-into-bigquery-using-cloud-functions

Dataflow aka Apache Beam

Dataproc (Spark)