Is there a way to predict the performance of a machine learning algorithm which was trained with unknown data?

I’m currently in my literature research and I just can’t find any related work. I want to do a kind of robots competence estimation of an interactive online learning system, with which I can predict e.g. the systems accuracy of a classification task from time to time. Normally you could just split up your data into a training and test set to validate it, but this I want to avoid. Do you know any publications or techniques that address this problem or at least related problems? Thanks in advance!

submitted by /u/CL4DSOFT
[link] [comments]

from Artificial Intelligence


Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s