SQL Reference

Spark SQL is Apache Spark’s module for working with structured data. This guide is a reference for Structured Query Language (SQL) and includes syntax, semantics, keywords, and examples for common SQL usage. It contains information for the following topics:

• ANSI Compliance
• Data Types
• Datetime Pattern
• Number Pattern
• Functions
  • Built-in Functions
  • Scalar User-Defined Functions (UDFs)
  • User-Defined Aggregate Functions (UDAFs)
  • Integration with Hive UDFs/UDAFs/UDTFs
• Identifiers
• Literals
• Null Semantics
• SQL Syntax
  • DDL Statements
  • DML Statements
  • Data Retrieval Statements
  • Auxiliary Statements