Azure / Azure/azureml-examples

Examples using expressions with TabularDataset.filter()

Open
#1,519 0 comments 0 reactions 0 assignees View on GitHub
example request
Dominant language
Jupyter Notebook
Stars
2k
Forks
1.7k
Avg merge
18h 18m
Merged PRs (30d)
2

Description

## What example? Describe it

[There is extremely limited documentation on the use of supported expressions to use with the experimental Dataset.filter() feature.](https://docs.microsoft.com/en-us/python/api/azureml-core/azureml.data.tabulardataset?view=azure-ml-py#azureml-data-tabulardataset-filter)
The only two examples provided are filtering based on another column equality and `starts_with()` method.

It's difficult to try out this feature without knowing a list of supported expressions. For example, I wanted to filter a TabularDatsaet based on a list of values in a column using `dataset.filter(dataset['column'].isin(['a','b'])).to_pandas_dataframe()` but this immediately throws an error: AttributeError: 'RecordFieldExpression' object has no attribute 'isin'

## Ask
Provide documentation or more examples of supported filter expressions we can use with [`TabularDataset.filter`](https://docs.microsoft.com/en-us/python/api/azureml-core/azureml.data.tabulardataset?view=azure-ml-py#azureml-data-tabulardataset-filter)

Contributor guide

Open the contributing guide

Research direction

Start with the linked TabularDataset.filter API documentation and the reported RecordFieldExpression error. Identify the supported filter expressions, then document them with examples, including filtering a column against multiple values. Done means the API documentation or examples clearly lists usable expressions and demonstrates their syntax.

Written by the indexing model from the issue text.

Assessment

Tech stack
azure, python
Domain
documentation, machine-learning
Issue type
Documentation
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.