Learn a system of linear inequalities given solutions

Instead of finding a solution to a system of linear inequalities (Ax + b >= 0), I want to find any system of linear inequalities that satisfy a set of feasible points and does not satisfy a set of infeasible points. As the image shows, I am given points (either a bunch together or one by one) labelled with in/out, yes/no, or similar binary attribute to know if it should be within the system or not, and I want to find lines that separate these. There should be some inductive method to fit any number of linear inequalities to satisfy these points. It's important that the output is a system of linear inequalities so it can be used as input into linear programming solvers to find new solutions. I've looked into SVM's but the model seams just to be a hyperplane. Maybe it is for use. A one-layer neural network should do the trick but then the number of lines must be set from start.

There are a few things to add to this problem.

1. We want to keep as few lines as possible, or, we want to assume as little as possible of the "true" data set we do not yet fully know of (as any machine learning algorithm does).
2. For the same reason as 1, we'd like to keep the lines as much "in between" the true and false points (just as SVM's)
• Are you familiar with kernelized SVMs? Sep 9 '21 at 18:34
• Yes but to make it work, one need to set some parameter indicating that the "green" dots are not allowed to be misclassified while the red ones are. Is that possible? Sep 13 '21 at 11:33
• Totally. If you know about hard-SVM and soft-SVM, then you can "combine" the two to make the greens always correct while allowing misclassifications in the red ones. Take a look at this question here. Anyways, one could come up with a formula for hard-SVM using a kernelized SVM, so its definitely possible. Sep 13 '21 at 11:54 