Questions tagged [machine-learning]
Questions about computer algorithms that automatically discover patterns in data and make good decisions based on them.
1,078
questions
0
votes
0answers
24 views
why divide norm of w in svm
So I get this through the math behind the SVM (Support Vector Machine), and I get this formula
$$(w^T)(x_1-x_2) = 2.$$
We then divide both side with norm of $w$ then we get the new formula
$$ \frac{w^...
0
votes
1answer
193 views
Pac learnable when changing distribution
if H is Pac learnable according to
Definition 3.1 (PAC Learnability) A hypothesis class H is PAC learnable
if there exist a function $m_H\colon(0,1)^2 \mapsto N$ and a learning algorithm with the
...
5
votes
1answer
150 views
What algorithm do SVMs use to minimize their objective function?
Support Vector Machines turn machine learning linear classification tasks into a linear optimization problems.
$$ \text{minimize } J(\theta,\theta_0) = \frac1n \sum_1^n \text{HingeLoss}(\theta,\...
1
vote
1answer
55 views
What kind of bigram probability smoothing is this?
I hope it isn't off topic but I need to understand this example. Given the corpus 12 1 13 12 15 234 2526 and smoothing factor of ...
0
votes
1answer
34 views
Confused on Variational AutoEncoder
I'm a bit confused on how Variational Autoencoders are trained. In particular I'm confused on how the latent variable is generated for each input.
My questions are as follows:
When running ...
0
votes
0answers
6 views
Which model to apply on such panel data with so may rows but for each unique id rows are 6-8 rows per unique id?
I am new to such panel data where I have multiple observation for same ID in different Quarter and I am not sure what kind of machine learning algorithm I can apply.
I have data from Q1-18 till Q4-...
0
votes
0answers
43 views
deep learning - is loss value should be divided by `seq_length`
I'm new to deep learning and I'm looking at train.py here: https://github.com/huanghao-code/VisRNN_ICLR_2016_Text/blob/master/train.py.
I run this code and the loss ...
0
votes
0answers
6 views
How is the dimensionality of the volume in ConvNets determined for a general case?
In ConvNets, I understand how the dimensionality of a flat image changes after convolving it with a single filter. For example, if you convolve a P x P x 1 image (assume no padding) with a filter with ...
0
votes
1answer
64 views
Can you share some pointers to get better at working alone in projects?
I am an ML Engineer who works alone in projects most of the time. I don't have people who are much smarter than me working alongside.
Most of the time, I feel that working alone is a tedious job,one ...
0
votes
0answers
23 views
Looking for references for real-world scenarios of data-poisoning attack on labels while doing supervised learning
Consider the following mathematical model of training a neural net : Suppose $f_{w} : \mathbb{R}^n \rightarrow \mathbb{R}$ is a neural net whose weights are $w$. Suppose during the training the ...
0
votes
1answer
17 views
Is there an online/offline tool that can perform K-means/median, given an initial centroid from the user?
The types of problems I am trying to solve are as follows:
Given a set of co-ordinates such as: (1,2), (3,3), (6,2), (7,1), a value of k such as k=3 and an initial set of centroids such as c1=(2,2) ...
0
votes
1answer
16 views
Signal translation with Seq2Seq model
I'm currently doing some research on signal processing and I got a dataset which includes the signal in itself and its "translation".
So I want to use a Many-to-Many RNN to translate the ...
0
votes
2answers
29 views
Can the perceptron classifier achieve perfect accuracy, on any data set?
I was thinking. Since any data can become linearly seprabale through kernel methods, meaning there is a dimension where this data is linearly seprable, so feed this processed data set into the ...
0
votes
1answer
21 views
Is any of the assumptions hold true for the mentioned?
Suppose the use of linear regression. The result of the MSE is 120.5(mean squared error) for the train-set. Wev'e reached the minimum of training the data.
Is it possible that by applying Lasso(L1 ...
1
vote
0answers
12 views
What is spatial information in neural network? [duplicate]
The architecture of the CNN model contains several convolutional layers, non-linear activations, batch normalization, and pooling layers. The initial layers learn the low-level concepts such as edges ...
0
votes
1answer
128 views
Computer Vision Techniques to find Slope of beach in the 2D Images?
What I am planning to do is to calculate the height and estimate the slope of the segmented Object. The camera will be static and the Object of Interest is the slope of the beach.
I am finding harder ...
0
votes
1answer
28 views
Is it possible to do face recognition with just the eyes?
Assuming the input photo is focused on a person's face, if the person is wearing a surgical mask, most face recognition software fail to identify the subject's face.
Most facial landmark models are ...
0
votes
0answers
16 views
Kohonen, 1 dimension, SOM, puzzle
We consider training one-dimensional open map of Kohonen with neurons in one-dimensional input space. We assume it is completed the phase of the device and the weights wi, i = 1,2, ..., N, are placed ...
1
vote
1answer
21 views
Is transfer learning applied on only similar datasets only?
I am trying to make a CNN model on different brands of logos . Firstly , I wrote a CNN from scratch and trained it on which I got 70% accuracy, I have total 40 classes and each class has 100 images . ...
1
vote
1answer
51 views
How does Gradient Descent treat multiple features?
As far as I know, when you reach the step, in a gradient descent algorithm, to calculate step_size, you calculate ...
1
vote
0answers
22 views
Even distribution of weighted sums across a period of time
I want to automatically&optimally split and distribute a number in several buckets as evenly as possible across a period of time.
Example:
5000 across 12 months, in 6 buckets, with weights 15%, ...
0
votes
1answer
37 views
Mapping categorical data in K-nearest neighbour
I have a data set which contains categorical data, for example:
...
1
vote
0answers
33 views
Reinforcement learning and Graph Neural Networks: Issue with entropy [closed]
I am currently working on an experiment to link reinforcement learning with graph neural networks.
This is my architecture:
Feature Extraction with GCN:
there is a fully meshed topology with ...
0
votes
1answer
13 views
Conditional probability in Expectation Maximization (EM)
I've got the following equation:
$p(j = 1 | x, \theta) = \frac{p(j=1,x | \theta)}{p(x | \theta)}$
Why does it hold? Or maybe, how do I use Bayes Theorem in this case, i.e. if we do not only have $p(j =...
1
vote
0answers
46 views
Best algorithm/model to establish relevance between events utilizing mixed data type (Tags, Time, x_coordinate, y_coordinate)? [closed]
I'm building a relevance ranking system for incidents occurrence and prevention. My goal is to use four attributes to establish relevance: tag (About 500 tags), x_coordinate, y_coordinate and time. ...
0
votes
1answer
13 views
What exactly is label noise?
I've been doing research on precollege summer programs, and one ongoing project that has come up is "Improving Label Noise Robustness with data Augmentation and Semi Supervised Learning". So,...
0
votes
0answers
15 views
Are Learning Classifier Systems considered (learning) agents?
Does a LCS model a learning, rule-based agent or does a LCS just implement the agent program (mapping of inputs to actions)?
According to Russel & Norvig :
agent = architecture + agent program
...
1
vote
1answer
47 views
What is the Number of epochs with no improvement after which training will be stopped.?
I am trying to make a Convolutional neural network. Training the images of different brands of Logos. Have 100 images per class and there are 40 classes. I have trained the model now want to check ...
0
votes
1answer
34 views
How does CNN deal with rotation invariant pictures?
I am trying to make a CNN model . Training the image . Want to know that When we apply kernel on image and take out the features of images. That features are rotation invariant or we have to apply ...
0
votes
1answer
346 views
How do you calculate the training error and validation error of a linear regression model?
I have a linear regression model that I've implemented using Gradient Descent and my cost function is a Sum of Squares Error function. I've split my full dataset into three datasets, a training set, a ...
3
votes
2answers
3k views
Q-learning in a Dynamic environment
I am new to reinforcement learning. Lately, I have learned Q-learning using the following tutorial.
Is Q-learning still possible if the environment is dynamic. Using the environment of the tutorial ...
19
votes
3answers
8k views
Line separates two sets of points
If there is a way to identify if two sets of points can be separated by a line?
We have two sets of points $A$ and $B$ if there is a line that separates $A$ and $B$ such that all points of $A$ and ...
0
votes
0answers
12 views
How do I choose the right model for production?
I am trying to build a classification algorithm having 28 classes. These classes consists of Logo of companies like adidas , Nike etc. I have very low dataset below than 100 images and greater than 70 ...
0
votes
1answer
67 views
Weighting function for Non Uniform Learning
Consider a hypothesis class $H = \cup_{n=1}^{\infty} H_n$, where for every $n\in N$, $H_n$ is finite. Find a weighting function $w : H ->[0, 1]$ such that $\sum_{h \in H} w(h) ⤠1$ and so that for ...
1
vote
1answer
29 views
Which pretrained model will be best for my dataset?
I am trying to build a classification algorithm having 28 classes. These classes consists of Logo of companies like adidas , Nike etc. I have very low dataset below than 100 images and greater than 70 ...
0
votes
0answers
30 views
Human brain controlled computer
It is already possible to let a computer drive the human brain to some limit like for example in the medical world, but will it be possible to let the human brain control a computer system by directly ...
0
votes
0answers
19 views
Recommender system - Binary rating adding a condition
I want to implement a recommender system based on collaborative filtering. Each user will have a set of visualized items (0-1's) and based on that similitude the recommendation will be generated.
In ...
0
votes
1answer
64 views
If i use other peoples code for my final year project does that come under Plagiarism?
I want to make a facial recognition project but my coding ability is very limited so I am going to be relying on other peoples code but if i use their code even if i change the variables and make ...
1
vote
0answers
51 views
any hope to solve np hard problem using deep learning? [duplicate]
I know some basic machine learning and deep learning. Now a days deep learning solve many types of problem. I working working optimization problem like np, np hard problem. Is there any hope to solve ...
0
votes
0answers
23 views
Why do Google Deepmind images always look the same?
There is a certain sameness to google deep mind images. Why do they always look like a bad tool album cover?
0
votes
0answers
17 views
Has GPT-3 put web designers out of work yet?
https://prototypr.io/post/gpt-3-design-hype/
Has GPT-3 had any effect on the how many humans are hired to do web design yet?
0
votes
0answers
17 views
Designing a neural network with LSTM and feedforward NN combination
Currently, I'm designing a neural network that works with reinforcement learning. In summary, the agent takes in information about itself and nearby agents and, in conjunction with global world ...
0
votes
1answer
28 views
Trying to figure out the best way to approach this problem with Computer Vision
Newbie to CV here so sorry of this is basic. Here's the deal, I have a program that I run many times. and each run I produce a screenshot. I need to compare screenshots from N-1 and N runs and make ...
0
votes
0answers
16 views
What does Online Transfer Learning Mean?
The last sentence of A review on transfer learning in EEG signal analysis states that:
Furthermore, online learning needs to be developed to ensure the
performance of transfer learning in practical ...
0
votes
2answers
76 views
What is the official name of a specific type of combination algorithm
Say that I have the following set of variables:
[A,B,C,D,E,F,G,H,I,J,K,L,M,N,O,P,Q,R,S,T,U,V,W,X,Y,Z]
The values represent a list of variables from a dataset. ...
1
vote
1answer
45 views
Show that if $\mathcal{H}$ is PAC learnable in the standard one-oracle model, then $\mathcal{H}$ is PAC learnable in the two-oracle model
This is a question $9.1$ from Understanding Machine Learning Chapter 3. It goes like this:
Consider a variant of the PAC model in which there are two example oracles: one that generates positive ...
3
votes
0answers
58 views
Axis aligned rectangles: why is A an ERM in the case of infinite domain?
I'm working on a problem 2.3a in Shalev-Shwartz/Ben-David's Machine learning textbook, which states:
An axis aligned rectangle classifier in the plane is a classifier that assigns 1 to a point if and ...
0
votes
0answers
14 views
What are Volterra classifiers
I want to learn about Volterra classifiers in-depth to understand the following papers
Papers
https://openaccess.thecvf.com/content_cvpr_2014/papers/Kang_Convolutional_Neural_Networks_2014_CVPR_paper....
0
votes
1answer
943 views
Condensed Nearest Neighbor Explanation
I have a question regarding the Condensed Nearest Neighbor algorithm from ...
1
vote
1answer
68 views
Can you suggest a topic for a Bachelor Thesis in Mathematics that is related to Machine Learning? [closed]
Context
I am a final year Bachelor of Mathematics student and next semester I will write my Bachelor thesis.
My interests are in Machine Learning (ML) and I will do a master in ML next year. More ...