Kyle GibsonPySpark: Using Arrays to Avoid Date Cross JoinsEverybody says to avoid cross joins, but sometimes we’re backed into a corner and don’t see any way to avoid them.4 min read·Dec 8, 2023----
Kyle GibsonPySpark: Trim All String ColumnsHow to easily trim all string columns in a PySpark DataFrame3 min read·Nov 29, 2023--1--1
Kyle GibsonUsing Dynamic Catalogs, Schemas, or Tables in Databricks SQLHave you ever wanted to parameterize your catalog, schema or table names in Databricks SQL? This article will show you how to be more…4 min read·Jun 16, 2023--1--1
Kyle GibsonPySpark: Get User Table Permissions in DatabricksI wanted to know which tables any given user had access to in Databricks.8 min read·May 1, 2023--1--1
Kyle GibsonSchedule YAML Pipeline RunsSchedule a YAML pipeline while ignoring code changes2 min read·Apr 11, 2023----
Kyle GibsonCount How Many Times a Value Appears in a Row Using Power QueryHow many times does TRUE appear in each row?8 min read·Mar 23, 2023----
Kyle GibsonCasting Data Types in PySparkHow often have you read data into your Spark DataFrame and gotten schema like this?5 min read·Mar 14, 2023----
Kyle GibsonHandling Multiple Excel Files and Multiple Sheets in Power QueryMultiple Excel files with multiple sheets and unknown amount of columns? No problem!12 min read·Mar 9, 2023----
Kyle GibsonFilter Out Null Rows with Power QueryWondering how to use Power Query (in Excel or Power BI) to filter out rows where the value in every column is null? Then this is the…4 min read·Mar 3, 2023----
Kyle GibsonPowerShell API Call: Cannot Send a Content-Body with this Verb TypePowerShell API Call Error: Cannot send a content-body with this verb-type3 min read·Feb 16, 2023--1--1