TELEMETRY: ONLINE|ACTIVE AI/DATA JOBS: 6,025
S&P 500 COVERAGE: 508 FIRMS
V87
VECTOR87

Data & AI Market Direction

03 // CLOUD & TECH ECOSYSTEM

Cloud Hyperscalers & Modern Data Platforms

Comparative telemetry tracking adoption, market share, and enterprise hiring across the Big 3 Hyperscalers (AWS, Azure, GCP) and leading modern data platforms (Databricks, Snowflake, BigQuery, Redshift, Microsoft Fabric).

Total Cloud Openings

1,035

Active job postings explicitly requiring cloud infrastructure

Multi-Cloud Coexistence

51.9%

Positions requiring or accepting 2 or more cloud platforms

Hyperscaler Leader

AWS vs Azure vs GCP

AWS (12.4%) closely followed by Azure (11.0%) and GCP (10.8%)

Lakehouse vs. DWH

535 vs 310

Databricks (535 jobs) vs. Snowflake (310 jobs)

The Cloud Wars: Market Penetration of Cloud & Data Platforms

Active job postings explicitly requiring the platform across 500+ enterprises

CLOUD WARS
The Cloud Wars: Market Penetration of Cloud & Data Platforms : Active job postings explicitly requiring the platform across 500+ enterprises
Metric / TechnologyActive Postings
AWS758
Microsoft Azure666
Google Cloud Platform638
Databricks541
Snowflake315
BigQuery112
Amazon Redshift55
Microsoft Fabric33
MULTI-CLOUD TELEMETRY

Multi-Cloud Interoperability & Overlap

Enterprise demand for multi-cloud competencies across the Big 3

AWS + Microsoft Azure481 positions
AWS + Google Cloud (GCP)409 positions
Azure + Google Cloud (GCP)377 positions
Tri-Cloud (AWS + Azure + GCP)365 positions

Over 51% of enterprise cloud postings demand or accept multi-cloud skills, showing that single-vendor lock-in is increasingly rejected in enterprise data architectures.

DEEP-DIVE PLATFORM 01

Google Cloud Platform (GCP) Deep-Dive

BigQuery, Vertex AI, Dataform SQLX, Dataflow streaming, and Looker semantic layer telemetry.

776 POSITIONS (12.88% OF MARKET)

Demand for Specific Google Cloud Services

Active job postings in the current snapshot

GCP STACK
Demand for Specific Google Cloud Services : Active job postings in the current snapshot
Metric / TechnologyPositions
Google Cloud Platform638
BigQuery112
Vertex AI73
Looker63
Google Cloud Dataflow26
Dataform2

Top Roles Operating on the GCP Ecosystem

Distribution of canonical roles requiring GCP / BigQuery / Vertex AI

GCP ROLES
Top Roles Operating on the GCP Ecosystem : Distribution of canonical roles requiring GCP / BigQuery / Vertex AI
Metric / TechnologyGCP Positions
AI Developer209
Machine Learning Engineer208
Data Engineer109
Data Scientist53
Data Architect46
Data Analyst29
Engineering Manager (AI/Data)12
AI / Data Product Manager12

Detailed Telemetry of Tracked GCP Services

Cloud82.2% of GCP roles

Google Cloud Platform

638 postings (10.59% of market)

Most frequently paired with:

AWSPythonMicrosoft AzureAI Agents / Agentic AI
Cloud14.4% of GCP roles

BigQuery

112 postings (1.86% of market)

Most frequently paired with:

SQLPythonSnowflakeData Governance & Quality
Cloud9.4% of GCP roles

Vertex AI

73 postings (1.21% of market)

Most frequently paired with:

PythonAI Agents / Agentic AIGenAI / Generative AILLM / Large Language Models
Business8.1% of GCP roles

Looker

63 postings (1.05% of market)

Most frequently paired with:

SQLPythonTableauBigQuery
Framework3.4% of GCP roles

Google Cloud Dataflow

26 postings (0.43% of market)

Most frequently paired with:

PythonApache SparkBigQuerySQL
Framework0.3% of GCP roles

Dataform

2 postings (0.03% of market)

Most frequently paired with:

Data Governance & QualityBigQueryLookerApache Spark

Architectural Notes & Production Insights

Serverless Lakehouse

BigQuery & BigLake

The foundational analytical engine on GCP. Dominates enterprise architectures through decoupled compute/storage, native Apache Iceberg support via BigLake, and in-warehouse ML/LLM execution (BigQuery ML).

BigQuery Architecture Deep-Dive on Substack ↗
Enterprise GenAI & MLOps

Vertex AI & Agent Builder

Unified platform for deploying Gemini and open-weight models, managing low-latency Vector Search, running automated Rapid Evaluations, and orchestrating production AI agents.

Vertex AI Documentation ↗
SQLX Analytics Engineering

Dataform (in BigQuery)

Native ELT transformation orchestrator inside BigQuery built on SQLX. Enables Git-versioned data models, automated data quality assertions, and dependency graphs without external infrastructure.

Dataform Best Practices ↗
Governed BI & LookML

Looker & Semantic Layer

Mission-critical semantic layer (LookML) defining unified business metrics across the enterprise. In the GenAI era, it serves as a deterministic grounding layer that prevents metric hallucinations.

Essay: Why AI Made Me Double Down on Being Data-Informed ↗

Top Corporations Hiring for This Stack (GCP)

BigQuery, Vertex AI, Dataform SQLX, Dataflow streaming, and Looker semantic layer telemetry.

#1Databricks
118 positions
#2Google (Alphabet)
66 positions
#3General Motors
20 positions
#4MongoDB
20 positions
#5United Parcel Service
19 positions
#6Hartford (The)
17 positions
#7Snowflake
16 positions
#8Cloudflare
15 positions
#9Anthropic
14 positions
#10Reddit
13 positions
ECOSYSTEM: AWS749 POSITIONS (12.43% MARKET)

Amazon Web Services (AWS)

AWS remains the volume leader in total job postings, driven by ubiquity in core compute (EC2/EKS), object storage (S3 as the default data lake substrate), and specialized analytical engines (Amazon Redshift, EMR, Athena, Glue). Modern enterprise data teams frequently run Databricks or Snowflake on top of AWS storage.

Top In-Demand Roles:

AI Developer (239)Machine Learning Engineer (214)Data Engineer (183)Data Scientist (59)Data Architect (54)Engineering Manager (AI/Data) (13)

Top Corporations Hiring for This Stack:

Databricks(129)
Amgen(46)
Amazon(21)
MongoDB(20)
ECOSYSTEM: AZURE662 POSITIONS (10.99% MARKET)

Microsoft Azure & Fabric

Microsoft Azure maintains strong enterprise momentum through deep integration with the Microsoft 365 ecosystem, Power BI, and Azure OpenAI Service. The arrival of Microsoft Fabric represents a strategic shift toward an all-in-one SaaS lakehouse engine competing directly with Snowflake and Databricks.

Top In-Demand Roles:

AI Developer (235)Machine Learning Engineer (175)Data Engineer (132)Data Architect (55)Data Scientist (54)Data Analyst (30)

Top Corporations Hiring for This Stack:

Databricks(129)
Ecolab(30)
Arthur J. Gallagher & Co.(25)
General Motors(20)
DATA PLATFORM BENCHMARK

Databricks vs. Snowflake: Lakehouse vs. Cloud DWH

The defining architectural battle in modern data platforms is between Databricks (pioneering the Lakehouse with Apache Spark, Delta Lake, and Unity Catalog) and Snowflake (expanding from cloud data warehousing into Iceberg tables, Snowpark, and Cortex AI). Our telemetry shows Databricks leading with 535 active postings vs. Snowflake with 310 postings.

DATABRICKS LAKEHOUSE535 positions
Anchored by Apache Spark, Delta Lake, and Unity Catalog. Strongly favored by teams requiring intensive distributed computing, real-time streaming, and deep ML model training (MLflow).

Top Corporations Hiring for This Stack:

Databricks182 positions
Amgen46 positions
Ecolab26 positions
Mastercard18 positions
SNOWFLAKE DATA CLOUD310 positions
Pioneered instant separation of storage and compute. Highly prevalent in enterprise Business Intelligence, financial services, and SQL analytics. Expanding into data lakes via Apache Iceberg and Cortex AI.

Top Corporations Hiring for This Stack:

Snowflake50 positions
Ecolab18 positions
Arthur J. Gallagher & Co.16 positions
Hartford (The)13 positions

Cloud Stack Co-occurrence Matrix

v_skill_cooccurrence

Telemetry showing which technology pairs most frequently appear together in the same job posting requirements.

Python + SQL1132x
LLM / Large Language Models + Python755x
AI Agents / Agentic AI + Python660x
AI Agents / Agentic AI + LLM / Large Language Models631x
AWS + Python584x
Python + Apache Spark544x
GenAI / Generative AI + Python538x
Microsoft Azure + Python501x
Python + R494x
AWS + Microsoft Azure484x