Supported C3-specific APIs on Data.SparkSession
In addition to Pandas APIs, C3 Data Spark supports a number of additional methods for data transformations and data type conversion.
Below is a list of the most relevant C3-specific APIs for Data Science.
| API Name | Description |
|---|---|
Data.SparkSession.py#from_spark | Construct a Data.Spark instance from native Spark instance. |
| Data.SparkSession#fetch | Construct a Data.Spark.DataFrame from a Fetchable type given Data.SparkFetchSpec |
| Data.SparkSession#evaluate | Construct a Data.Spark.DataFrame from a PersistableEvaluatable type given Data.SparkEvaluateSpec |
| Data.SparkSession#evalMetrics | Construct a Data.Spark.DataFrame from a MetricEvaluatable type given EvalMetricsSpec |
| Data.SparkSession#readFeatureSet | Construct a Data.Spark.DataFrame from a FeatureEvaluatable type given Feature set ID |
| Data.SparkSession#load_table | Construct a Data.Spark.DataFrame from a DataLake.Table |