Supported Data Spark Series APIs

The C3 Agentic AI Platform supports many Pandas APIs to perform dataset operations.

Below is a list of supported Series APIs. Functionality is similar to functionality from Pandas. Methods annotated with an asterisk (*) are partially supported.

API Name	Link to Pandas on Spark 3.5.8	Comment
`T`	T
`abs`	abs
`add`	add
`add_prefix`	add_prefix
`add_suffix`	add_suffix
`agg`	agg
`all`	all
`any`	any
`append`	append
`*apply`	apply	Doesn't support external reference inside lambda function
`argmax`	argmax
`argmin`	argmin
`argsort`	argsort
`asof`	asof
`astype`	astype
`at_time`	at_time
`autocorr`	autocorr
`backfill`	backfill
`between`	between
`between_time`	between_time
`bfill`	bfill
`bool`	bool
`clip`	clip
`combine_first`	combine_first
`compare`	compare
`copy`	copy
`corr`	corr
`count`	count
`cov`	cov
`cummax`	cummax
`cummin`	cummin
`cumprod`	cumprod
`cumsum`	cumsum
`describe`	describe
`diff`	diff
`div`	div
`divide`	divide
`divmod`	divmod
`dot`	dot
`drop`	drop
`drop_duplicates`	drop_duplicates
`droplevel`	droplevel
`dropna`	dropna
`dt`	dt
`duplicated`	duplicated
`empty`	empty
`eq`	eq
`equals`	equals
`explode`	explode
`ffill`	ffill
`fillna`	fillna
`filter`	filter
`first`	first
`first_valid_index`	first_valid_index
`floordiv`	floordiv
`ge`	ge
`get`	get
`groupby`	groupby
`gt`	gt
`hasnans`	hasnans
`head`	head
`idxmax`	idxmax
`idxmin`	idxmin
`*iloc`	iloc	Only supports get values. Set values have no effect.
`index`	index
`interpolate`	interpolate
`is_monotonic`	is_monotonic
`is_monotonic_decreasing`	is_monotonic_decreasing
`is_monotonic_increasing`	is_monotonic_increasing
`is_unique`	is_unique
`isin`	isin
`isna`	isna
`isnull`	isnull
`item`	item
`items`	items
`iteritems`	iteritems
`keys`	keys
`kurt`	kurt
`kurtosis`	kurtosis
`last`	last
`last_valid_index`	last_valid_index
`le`	le
`*loc`	loc	Only supports get values. Set values have no effect.
`lt`	lt
`mad`	mad
`mask`	mask
`max`	max
`mean`	mean
`median`	median
`min`	min
`mod`	mod
`mode`	mode
`mul`	mul
`ndim`	ndim
`ne`	ne
`nlargest`	nlargest
`notna`	notna
`notnull`	notnull
`nsmallest`	nsmallest
`nunique`	nunique
`pad`	pad
`pct_change`	pct_change
`*pipe`	pipe	Doesn't support external reference inside lambda function
`pop`	pop
`pow`	pow
`prod`	prod
`product`	product
`quantile`	quantile
`radd`	radd
`rank`	rank
`rdiv`	rdiv
`rdivmod`	rdivmod
`reindex`	reindex
`reindex_like`	reindex_like
`rename`	rename
`rename_axis`	rename_axis
`repeat`	repeat
`replace`	replace
`resample`	resample
`reset_index`	reset_index
`rfloordiv`	rfloordiv
`rmod`	rmod
`rmul`	rmul
`round`	round
`rpow`	rpow
`rsub`	rsub
`rtruediv`	rtruediv
`sample`	sample
`searchsorted`	searchsorted
`sem`	sem
`shape`	shape
`shift`	shift
`size`	size
`skew`	skew
`sort_index`	sort_index
`sort_values`	sort_values
`squeeze`	squeeze
`std`	std
`str`	str
`sub`	sub
`sum`	sum
`tail`	tail
`take`	take
`to_csv`	to_csv
`to_dict`	to_dict
`to_excel`	to_excel
`to_frame`	to_frame
`to_json`	to_json
`to_latex`	to_latex
`to_list`	to_list
`to_markdown`	to_markdown
`to_pandas`	to_pandas
`to_string`	to_string
`transform`	transform
`transpose`	transpose
`truediv`	truediv
`truncate`	truncate
`unique`	unique
`unstack`	unstack
`update`	update
`value_counts`	value_counts
`var`	var
`where`	where
`xs`	xs