Analytics

Too Many Data Engineers? How to Get the Right Balance

As companies grow and become more data-dependent, data engineers find themselves in huge demand. Employers are snapping up all the best data engineering talent they can find, and some businesses have invested in fast-track professional development paths for DBAs and other more junior data positions. But here’s the thing — data engineers work best when they’re part of a balanced team, just like every other professional. Some organizations overlook this point.

Snowflake CEO Frank Slootman Talks Data Cloud Evolution | Rise of The Data Cloud | Snowflake

On the season 2 premiere of the Rise oF The Data Cloud Podcast, host Steve Hamm talks with Snowflake CEO Frank Slootman, and they give us an update on the transition of Snowflake from a private startup to a public company, the impact of the Data Cloud over the past year for organizations across industries, the future of data sharing and much more.

Enabling kubectl for CDE

The kubectl tool provides direct administrative access to the Kubernetes cluster underlying a CDE service, which is useful for troubleshooting, among other things. This video will demonstrate how to set up kubectl access. To enable kubectl, we will need a couple of prerequisites. We wiil need the kubeconfig file from the CDE service. We will need to get and authorize the IAM user, and then need to make sure that everything is set up correctly, both for kubectl and some other tools like k9s.

New flexibility: Run your Dataprep jobs with BigQuery or Dataflow

Cloud Dataprep by Trifacta is Google Cloud’s intelligent data service for visually exploring, cleaning, and preparing structured and unstructured data for analytics and machine learning. Due to its serverless architecture, Dataprep does not need any infrastructure to deploy or manage, and is fully scalable.