Questions tagged [machine-learning]

Questions about computer algorithms that automatically discover patterns in data and make good decisions based on them.

Filter by
Sorted by
Tagged with
0 votes
0 answers
7 views

Role of State Dynamics Target Network in DDPG

I am trying to create a variant of DDPG in MATLAB that has no action-value $\langle Q \rangle$ net, but that instead works with networks $\langle V \rangle, \langle f \rangle, \langle r \rangle$, and ...
0 votes
0 answers
15 views

Bellmann Error with Time Step

I define the return $G$ as the discrete time integral of the reward $G = \Delta t \sum_{t = 0, ..., T}r_t$. In supposing $\Delta t = 1$ throughout, my instructor wrote the following formula for the ...
0 votes
0 answers
12 views

How to load an image dataset for deep learning in Python? [closed]

I'm still fairly new to deep learning and I find myself asking a lot of questions in a single day, which can make me feel a bit silly. I'm encountering an issue while using glob to load images. I had ...
-1 votes
0 answers
20 views

Learning Parities via Gradient Descent

[Disclaimer: Crossposted in cstheory --> Link] In their recent work [DM20] Daniely and Malach prove that a two layer sufficiently wide NN can learn parities via gradient descent (GD). Since [...
0 votes
0 answers
18 views

Facial Recognition

I need an algorithm that can do facial recognition in a video based on a training set. For any faces detected, it should give an output as how much the face matches with the faces in the training set. ...
0 votes
0 answers
21 views

If the data that I input for locality sensitive hashing is sensitive, should its resulting hash also be considered sensitive?

Is it correct to assume that if the input that I hash is sensitive, that I should also consider the locality-sensitive hash generated for that input to be sensitive? I presume that, if an attacker has ...
1 vote
0 answers
27 views

Draw the decision boundary of an neural network

I'm really confused when it comes to what the difference between bias and threshold is. I have read that they are basically the same thing and that they serve the same purpose. Being on opposite sides ...
  • 21
0 votes
0 answers
8 views

Resources to learn NLP

I am an undergraduate student in mathematics. I have a fair bit of experience with deep learning in computer vision research and am willing to dabble into NLP. I hope that things won't be very ...
0 votes
0 answers
31 views

How to get started with computational research after a PhD in Physics?

I have a PhD in theoretical physics, where I had worked on mathematical models of hydrodynamics around compact objects. I have basic knowledge of programming in C/C++ and Python. Currently, I am more ...
  • 101
0 votes
1 answer
17 views

How sparsity term in loss function for sparse autoencoder is making hidden units inactive?

I am working on a Sparse Autoencoder but Andrew NG's notes are hard to understand. My question is about the following equation: Loss Function. In sparse autoencoder, the goal is to inactive some ...
0 votes
0 answers
17 views

Dynamic Bandwidth Parameter for Locally Weighted Linear Regression (LWLR)

When performing LWLR we set the weight based on $w^{(i)} = e^{\dfrac{(x^{(i)}-x)^2}{2\tau^2}}$ where $x$ is the input for our prediction model. Given two x's - $x_1 and x_2$ s.t. $x_1 != x_2$ and $| ...
  • 1
2 votes
3 answers
147 views

Does ChatGPT use specific sub-programs

I have had a somewhat hard time trying to understand how ChatGPT can "solve" some tasks that cannot be entirely cast as language-model-based rephrasing of textual subsets of the internet ...
0 votes
1 answer
1k views

What are the 175 billion parameters used in the GPT-3 language model?

I am currently working my way through Language Models are Few-Shot Learners , the initial 75-page paper about GPT-3, the language learning model spawning off into ChatGTP. In it, they mention several ...
  • 1,953
0 votes
1 answer
79 views

Weighted-Graph Datasets

I am searching for datasets to evaluate an algorithm designed for tasks such as node-classification (edge-prediction, etc.) on weighted and potentially directed graphs. The Stanford Network Analysis ...
0 votes
0 answers
16 views

Matching to Optimise HOTA

I'm trying to understand HOTA: A Higher Order Metric for Evaluating Multi-Object Tracking and in particular the section "Matching to Optimise HOTA" on page 8. There is a paragraph that says: ...
2 votes
1 answer
25 views

System Identification vs Machine Learning for dynamic system modelling

So I found another discussion regarding this, but the answers did not fully separate the differenced between SID and ML. Hopefully a discussion here can shed some light on some larger differences both ...
1 vote
0 answers
20 views

Details about KNN based background segmentation

I build a python script which uses OpenCV implementation of KNN Backgroud Segmentation/Remover. I know the basics of how KNN works, but not how the background segmentation works. For the MOG algorithm ...
  • 111
0 votes
1 answer
23 views

Convolutional neural network for non-image data

I am working on a project for the prediction of preeclampsia, and one of the algorithms to be used is the convolutional neural network. I am a beginner in machine learning, and I am struggling to ...
0 votes
0 answers
19 views

How do you prove a presence of GAN generated samples being exactly (or almost exactly) identical to real observations?

Suppose that $X\in\mathcal{X}$ is data in abstract space and $Z\in\mathcal{Z}$ is random noise vectors in latent space over a defined prior $P(Z)$ (e.g., Gaussian). Then, let $G$ and $D$ denote ...
1 vote
0 answers
33 views

grouping/clustering of lines using Hough transform

I am new to Hough transform, though I have some basic idea about it. I am currently trying to fit the best line to a cluster of points $\left(x_i, y_i\right), i = 1,2,\cdots , N$, where there are ...
1 vote
1 answer
37 views

Machine Learning algorithm to learn submodular set functions

I'm looking for some machine learning algorithm to train on data that are sampled from some submodular set function and I want the learned model predictions also obey submodularity. For example linear ...
0 votes
1 answer
60 views

How can I find a Stable Diffusion program?

Well, I know that I'm going to ask too much. So, I really want to ask you a totally (powerful (!)) free completely off-line code to generate prompt-based images like midjourney. I want to run with my ...
  • 141
0 votes
0 answers
13 views

What should I look for in 2-year colleges if I want to do compsci (ML) at GT or UGA?

I'm going off to college soon and I'm trying to find an inexpensive (<$8K/year) in-state (Georgia) 2-year college to go to before I hopefully eventually transfer to Georgia Tech (I may find myself ...
0 votes
1 answer
38 views

Reinforcement Learning Reward Function for Optimizing Golf Aim?

I read this article, mentioning that either here, or StackOverflow would be the best places to ask generic machine learning questions, however, if the question isn't programming specific with a ...
  • 103
0 votes
0 answers
12 views

What are the set of actions in reinforcement learning?

I'm reading https://ai.stanford.edu/~ang/papers/icml04-apprentice.pdf In 2. Preliminaries, they claim that the reward function takes a state in S to an action $$R : S \rightarrow A$$ But in the next ...
1 vote
1 answer
25 views

Good Practice : Which VAE latent variable to use in dimensionality reduction

I'm trying to use a VAE (CNN-VAE to be exact) to reduce the dimension of some images I have in a dataset. I successfully trained my VAE, but now I'm not sure of the latent variable to return. Should I ...
1 vote
0 answers
53 views

Regarding constant * opt approximation in agnostic learning

In standard agnostic learning, we assume that there is a concept class $H\subseteq \{h:\{0,1\}^n\rightarrow \{0,1\}\}$. Given samples from a distribution $D:\{0,1\}^n\times \{0,1\}\rightarrow [0,1]$, ...
1 vote
1 answer
55 views

How can I understand the proof of the VC dimension of half-spaces in d-dimensions?

Statement : A half space is set of all points on one side of a linear separator, i.e., a set of the form $\{x \mid w^{T}x \ge t\}$. The VC-dimension of half spaces in $d$-dimensions is at least $d+1$. ...
  • 35
0 votes
0 answers
14 views

What exactly is meant by the term"model" in machine learning?

I am very confused. What is the meant by the term"model" in machine learning?Is it any equation/expression or any software/program or a vector?? I have tried to explore google but couldn't ...
  • 129
0 votes
0 answers
23 views

Relation between machine learning and computer vision?

What is correct concept in regards to relation between machine learning and computer vision? As shown red encircled in attached snap, computer vision is a subset of machine learning or Is it an ...
  • 129
0 votes
0 answers
10 views

Editing facial features

Photoshop offers some great image processing filters under the term "Face-Aware Liquify". I want to integrate such techniques into an automated processing system I am currently implementing (...
2 votes
1 answer
40 views

Why are restricted Boltzman machines not considered useful?

I've been under the impression that RBM can be used for a variety of applications and a cursory search on google seems to confirm this. But I've heard from multiple people (including a peer reviewer) ...
0 votes
0 answers
27 views

How to detect touching on a glass with Object Tracking?

I am working at a Biomedical Center right now and my task is to track both pawns of rats and count the number of times they touch the glass surface. To elaborate. I have a setup that contains one ...
2 votes
1 answer
379 views

What are common ways to distinguish between local minima and long run-time in hyperparamteer optimization

I'm using Bayesian optimization for a pretty cost expensive function in the context of neural networks in order to optimize hyperparameters for the neural net. Is there a general, quantitative way to ...
1 vote
1 answer
56 views

Efficient algorithm for finding linear combination of piecewise functions

While porting an algorithm, I having a bit of a problem with finding an efficient algorithm for finding a linear combination of piecewise functions. The procedure is described in the Table 3 of the ...
  • 113
0 votes
0 answers
36 views

resolving in CDCL

When resolving in Conflict driven clause learning, it is the case that if you resolve a conflicting clause with the reason of the negation of one of his literals, then this results in another ...
0 votes
0 answers
13 views

Doubt about Subword Regularization algorithm using Unigram Language Model [Kudo, 2018]

I've gone through the paper Subword Regularization: Improving Neural Network Translation Models with Multiple Subword Candidates link: https://arxiv.org/pdf/1804.10959.pdf The algorithm is as ...
1 vote
0 answers
15 views

Are these representations of the Bellman Equation equivalent?

I've found two slightly different Bellman Equations. Are they totally equivalent? I see the one on the bottom has an s' in the reward. Does this or anything else about the groupings change anything ...
  • 119
1 vote
1 answer
22 views

Is there a good rule of thumb for regularization constants?

I'm trying to train some linear logistic regression models and I need regularization. My models contain around 4000 features. I know that without regularization, a good rule of thumb is to have 10x ...
  • 111
-1 votes
1 answer
41 views

Where should I start for making an AI Bot that processes on screen prompts

I would love to learn visual AI and what better way than creating a bot to play offline games. The problem is with no experience in AI other than Azure through my college, I have no experience. Does ...
0 votes
0 answers
26 views

On the bounds of number of iterations of generative adversarial networks

I've been wondering whether there is any analysis on the bounds of number of iterations of generative adversarial networks (GAN), where here 1 iteration refers to 1 step of generator + discriminator. ...
  • 123
0 votes
0 answers
16 views

Why is LSTM hidden state called hidden?

If I undersand correctly, in a LSTM, the output is the concatenation of the consecutives hidden states $\text{output} = concat_{1\leq ï\leq n}(h_i)$. But then why are those hidden states $h_i$ called &...
  • 126
0 votes
0 answers
17 views

Learner Algorithm Time & Sample Complexity

Let $X=R^{2}$. Let $u=\left(\frac{\sqrt{3}}{2},-\frac{1}{2}\right),\ w=\left(-\frac{\sqrt{3}}{2},-\frac{1}{2}\right),\ v=\left(0,1\right)$ and $C=H=\left\{h\left(r\right)=\left\{\left(x_{1},x_{2\ }\...
0 votes
1 answer
60 views

Cosine distance in a space, and cheating?

I read an example of using cosine distance in RGB space, and it pointed out that (eg.) dark red and light red have a cosine distance (CD) of zero because CD only gives you the angle between vectors ...
1 vote
0 answers
27 views

pseudo dimension of the minimum of functions

Suppose a real-valued function class $\mathcal{F}$ with pseudo dimension less than $d$, I am wondering what is the pseudo dimension of the following function class \begin{equation} \mathcal{F}_2 = \{\...
  • 111
0 votes
0 answers
30 views

Sensitivity analysis of Multi-Layer Perceptron Neural Networks

I have used Multi-Layer Perceptron Neural Networks to do a binary classification. Now I want to perform a sensitivity analysis. I am planning to follow a similar approach to this paper. In case the ...
  • 1
0 votes
0 answers
11 views

Calculate the joint probability of two nodes in Markov Random Field

I have a Markov Random Field (MRF) model as described in this picture. I know the distribution factorizing over the graph is given by $$ p(x_{1:N}) = \frac{1}{Z} \prod\limits_{n=2}^{N} \psi_{n-1, n}(...
0 votes
0 answers
226 views

How many model parameters do R-CNN, Fast R-CNN and Faster R-CNN have respectively?

I am making research on object detection and I would like to know the number of parameters these three models obtain.
1 vote
1 answer
36 views

K-Modes Clustering with Partially-Overlapping, Variable-Length Data?

I'm working on a project that's attempting to cluster books using machine learning. I'm using the K-Prototypes algorithm for clustering data that has both numerical and class-based data. Under the ...
  • 113
0 votes
1 answer
23 views

How much faster would a semantic segmentation model be with just 2 classes compared to 100 classes?

Let's say I have a semantic segmentation model that distinguishes between 100 classes of objects, and the speed of running the model is 1 image per second. Now let's say I take the same model ...

1
2 3 4 5
24