Kyle GibsonPySpark: Using Arrays to Avoid Date Cross JoinsEverybody says to avoid cross joins, but sometimes we’re backed into a corner and don’t see any way to avoid them.Dec 8, 2023Dec 8, 2023
Kyle GibsonPySpark: Trim All String ColumnsHow to easily trim all string columns in a PySpark DataFrameNov 29, 20231Nov 29, 20231
Kyle GibsonUsing Dynamic Catalogs, Schemas, or Tables in Databricks SQLHave you ever wanted to parameterize your catalog, schema or table names in Databricks SQL? This article will show you how to be more…Jun 16, 20231Jun 16, 20231
Kyle GibsonPySpark: Get User Table Permissions in DatabricksI wanted to know which tables any given user had access to in Databricks.May 1, 20231May 1, 20231
Kyle GibsonSchedule YAML Pipeline RunsSchedule a YAML pipeline while ignoring code changesApr 11, 2023Apr 11, 2023
Kyle GibsonCount How Many Times a Value Appears in a Row Using Power QueryHow many times does TRUE appear in each row?Mar 23, 2023Mar 23, 2023
Kyle GibsonCasting Data Types in PySparkHow often have you read data into your Spark DataFrame and gotten schema like this?Mar 14, 20231Mar 14, 20231
Kyle GibsonHandling Multiple Excel Files and Multiple Sheets in Power QueryMultiple Excel files with multiple sheets and unknown amount of columns? No problem!Mar 9, 2023Mar 9, 2023
Kyle GibsonFilter Out Null Rows with Power QueryWondering how to use Power Query (in Excel or Power BI) to filter out rows where the value in every column is null? Then this is the…Mar 3, 2023Mar 3, 2023
Kyle GibsonPowerShell API Call: Cannot Send a Content-Body with this Verb TypePowerShell API Call Error: Cannot send a content-body with this verb-typeFeb 16, 20231Feb 16, 20231
