Consistent and standardized naming conventions can help speed up both development and understanding. It's critical to establish a pattern and while exceptions do occur, make sure it's communicated and followed to the extent possible.
ReadSetting up secure, MFA-compatible authentication for Snowflake using Python and Snowpark. This walkthrough covers environment setup, RSA key-pair generation, and connecting to Snowflake without interactive authentication prompts.
ReadIntegrating git repos in a data engineering platform can help speed up development cycles and CICD workflows dramatically. In this walkthrough, I'll show how to setup a repo hosted on github to interact with your snowflake environment.
ReadLLMs made available by companies such as OpenAI, Anthropic, Google, and others can be useful for learning new things. I enjoy listening to podcasts and audiobooks, but there are some topics that may not have a lot of coverage. To bridge this gap, I set out to create an automated workflow where an LLM can generate the content for podcasts and a follow-up pipeline to convert this to audio files and ultimately a combined mp3.
Read