1 min readfrom Machine Learning

[D] Looking for definition of open-world ish learning problem

Hello!

Recently I did a project where I initially had around 30 target classes. But at inference, the model had to be able to handle a lot more classes than these 30 targets i had in my training data. Therefore, I couldn’t just make a ”normal” classifier that predicts one of the 30 target classes.

I instead went with a metric learning approach where i adapted different flavors of arcface/cosface etc. to create an embedding space that tried to maximize inter cosine distance, and minimize intra cosine distance.

At inference, I then set a similarity threshold and clustered objects accordingly. The idea was of course that the objects that formed cluster belonged to the same target class.

It worked surprisingly well on classes the model had never seen before during training.

Now to my question: What is this kind of ML called? Its not really OOD detection since im clustering everything and not really classifying stuff as ”unknown”

submitted by /u/ralfcat
[link] [comments]

Want to read more?

Check out the full article on the original site

View original article

Tagged with

#machine learning in spreadsheet applications
#generative AI for data analysis
#rows.com
#Excel alternatives for data analysis
#big data management in spreadsheets
#conversational data analysis
#automated anomaly detection
#real-time data collaboration
#financial modeling with spreadsheets
#intelligent data visualization
#data visualization tools
#enterprise data management
#big data performance
#data analysis tools
#data cleaning solutions
#natural language processing for spreadsheets
#open-world learning
#metric learning
#inference
#target classes