Questions about design and properties of agents that act in a dynamic environment and make decisions towards some goal without user control.

learn more… | top users | synonyms

3
votes
0answers
48 views

Maximizing pruned branches in an alpha-beta tree

Preliminary After doing some searches of similar questions posted here and elsewhere, i feel like this is the right place to inquire about, now let's get through some boring main notations... A ...
1
vote
2answers
97 views

Does the the undecidability of the Halting Problem eliminate the possibility of 'Hard AI'? [duplicate]

I'm defining 'Hard AI' as a human-equivalent intelligent machine, or beyond that. Contrast with 'Soft AI' the type of software that runs on your email filter for example. I've been chewing on this ...
0
votes
1answer
29 views

Is applying a formula a kind of reasoning?

Supposed I have a set of simple rules, e.g. if A is between 10 and 20 and B is between 3 and 5, then use 3 and this rules are used in some kind of (more or less)...
1
vote
1answer
33 views

Reinforcement Learning - Q Learning

I am having trouble understanding the following problem and Q learning in general. What I know so far about Q learning is that Q-learning is a model free method, i.e., it doesn’t need to learn P(s’|...
3
votes
1answer
38 views

Evaluation functions of Minimax algorithm

Let's say we have the following relationship between $f_1$ and $f_2$: $$f_2(s) = \sqrt{1 + f_1(s)}$$ And $f_1$ returns a positive value. Why is it that minimax search using $f_2$ is guaranteed to ...
0
votes
2answers
43 views

Best starter resources for learning about AI [closed]

I want to start learning of AI and have an idea to program "social evolution simulator" but want to hear any advice to avoid creation "well known bicycles" and get strong knowledge-base. Will be ...
1
vote
0answers
30 views

Posterior of a DP in a Dirichlet process mixture model

Draws from a Dirichlet process (DP) are discrete, and exhibit clustering behaviour. Dirichlet Processes The Dirichlet Process ($DP$) is a stochastic process used in Bayesian nonparametric modelling....
3
votes
1answer
94 views

Does the Halting Problem prove that true Artificial Intelligence is impossible?

The Halting Problem demonstrates that there are things that a machine can never be programmed to do. Is this proof that true Artificial Intelligence - that is, the ability for a machine to think and ...
3
votes
0answers
19 views

Inconsistent results with Q-learning

I'm running a q-learning agent in tic tac toe against a minimax agent and measuring the tie rate (since you can never win against minimax). When I run 10,000 training games, I've found that there seem ...
1
vote
0answers
24 views

Detecting facial texture [closed]

I would like to extract facial texture information to feed into my neural network as an indicator of beauty. The data set I am working with is just a face framed by a black box. Each face is centered ...
3
votes
0answers
28 views

How do neural networks create results like its inputs?

I understand basic neural networks (input layer, hidden layers, output layer) and gradient descent learning. However I keep hearing about news talking about neural networks painting and making jazz ...
1
vote
1answer
23 views

Difference between SNN RL and DNN RL?

In Reinfrocement Learning (RL) in Neural Networks (NNs), I've seen two approaches to Q-learning. The first is to tile the state space with basis functions using Spiking Neural Networks (SNN) to ...
4
votes
0answers
24 views

Are the Confabulation Theories of Thaler and Hecht-Nielsen Isomorphic?

Both S. L. Thaler and R. Hecht-Nielsen have set forth neural-based theories of "confabulation" applicable to machine learning. The essential mathematics of Hecht-Nielsen is set forth in his paper "...
2
votes
1answer
34 views

Predicting next action to take to reach a final state

Does anyone know of an algorithm that could be used to determine the next action to take to reach a desired state when trained on time-series data? For example, a robot starts at a certain state, ...
2
votes
2answers
59 views

How should i guide a program to perform correct things? [closed]

I want to make a small model of A.I. which can learn itself. I am inspired by 1000+ monkey theorem which states that if 1000+ monkey bangs a keyboard for enough long, then they will eventually produce ...
2
votes
1answer
77 views

How do I stop “cheating” in reinforcement learning (MLP+Evo. Algorithm)?

I have a two hidden-layer MLP. I am trying to teach it classification of the sine function. For instance, if there is an [x,y] point above the sine function, the ANN should classify that point as a 1. ...
1
vote
1answer
66 views

Bidirectional Dijkstra vs Dijkstra

Are there any kind of graphs where Bidirectional Dijkstra would expand more than Dijkstra? I tried to come up with an argument like this: Let node $n$ be expanded by Bidirectional Dijkstra. Now ...
2
votes
1answer
36 views

What Exactly is “Improvement” in Seed AI?

From LessWrongWiki, a seed AI [I]mproves itself by recursively rewriting its own source code without human intervention. Some would even say this could bring about an Intelligence Explosion. ...
2
votes
1answer
92 views

Why Isn't This Outlier Score/Reconstruction Error Not Squared?

I was looking through a paper called "AI2 : Training a big data machine to defend", and saw this (http://people.csail.mit.edu/kalyan/AI2_Paper.pdf) $score(X_{i}) = \sum_{j=1}^{p} (|X_{i} − R^{j}_{i}|)...
3
votes
1answer
64 views

How are artificial intelligence and Natural intelligence compared?

I can remember reading that computer intelligence is heading (or maybe the most powerful ones already have) towards the Natural intelligence of a four-year-old child. But how are the two kinds of ...
1
vote
1answer
34 views

How to improve the accuracy of automatic conflict resolution?

A little background information from my previous question:http://english.stackexchange.com/questions/318528/conflict-resolution-how-to-decide-if-two-words-are-generally-unmistakable When a court ...
4
votes
2answers
124 views

About randomness and minmax algorithm with alpha beta pruning

Will choosing the child of a node randomly in the alpha beta algorithm have a better chance to get a cut off than choosing them in order? Here's the pseudocode with my addition marked with ***. <...
2
votes
1answer
31 views

How is the environment designed for testing a reinforcement learning algorithm?

I'm working on a project, and have a candidate algorithm which I'd like to test. Before I go any further, I need to get the hang of how to code the "structure" of the environment in which my system is ...
1
vote
0answers
17 views

Dyna-Q in non-deterministic domains

I've implemented the Dyna-Q reinforcement learning algorithm and it works perfectly on a discrete deterministic environment, the cliff. However, when applying it to a continuous environment (mountain ...
-1
votes
1answer
51 views

Turing tests and humans

How are the questions framed in Turing tests? I mean what factors would one consider before framing questionnaire for the Turing Test.How the questions should be framed to make the test unbiased for a ...
1
vote
0answers
26 views

KDD Machine Learning using K-NN Algorithm Classification Problem

I'm trying to solve a classification problem from the KDD cup archive of 2004. Details can be found here: KDD 2004 Archive I'm only dong the particle physics part. The description of dataset is as ...
2
votes
2answers
53 views

Symmetry in Pattern Databases

I am trying to understand the use of symmetry in pattern databases (Heuristics, single agent search). This is too specialized of a topic to find common videos or explanations in general. I read the ...
0
votes
0answers
13 views

understanding kohonen self organized feature maps

I was learning self organizing feature maps the other day. I want to intuitively understand it because I'm not that good at math. But I still am not very clear about it. I can easily understand ...
1
vote
0answers
34 views

Good language for introduction to self-modifying algorithms? [closed]

So I am trying to find a language with which i can write code to build/search through deductive reasoning 'nets', as well as self-modify it's search algorithms based on information learned from these ...
1
vote
1answer
50 views

Expectation Maximization Algorithm for simple naive Bayesian network

I am trying to understand the following network A has two children - B & C (aka common cause) All the variables are binary and can be either 0 or 1. In data values are missing only for some ...
1
vote
2answers
70 views

Skolem constant in existential instantiation for first order logic

For any sentence $\alpha$, variable $v$, and constant symbol $k$ that does NOT appear elsewhere in KB: $$\dfrac{\exists \nu. \alpha}{\mathsf{subst}(\{ \nu / k \},\alpha)}.$$ E.g., $∃x. \mathrm{Crown}(...
2
votes
1answer
44 views

Role of computational power in recent AI developments

Today Google's AI won its first game of Go against Lee Sedol, one of the best Go players on the planet. Image interpretation and self-driving cars are other recent success stories in machine learning. ...
0
votes
1answer
107 views

How different is the working of SNN (Spiking Neural Network) as compared to a real Neuron System in biological systems?

Assuming its one step closer to realism as compared to ANN, DNNs and other Neural Network models, what are the primary differences between a real neuron system and SNN?
3
votes
1answer
115 views

What category of AI would a 2048 bot be considered?

I have just delved into the realm of AI and from what I can tell its a very vast field of study. I am a game programmer, so AI in games is particularly interesting to me. My question is, what type of ...
0
votes
1answer
45 views

a program discovering himself how to solve propositional calculus

it is well-known that propositional logic problems such as $$ (p\leftrightarrow q) \lor r \quad\overset{?}{\vdash}\quad (((p\lor q)\to(p\land q)) \land \lnot r)\lor r$$ can be simply solved by ...
1
vote
1answer
76 views

Information about ε-greedy algorithms

I'm working on a paper that uses ε-greedy algorithms for choosing episodes of a sarsa q-learning algorithms. I searched for algorithm but couldn't get so much. Can you please give me the algorithms ...
2
votes
1answer
70 views

Robot lawyer algorithm [closed]

I have a background in physics and have taken some few classes online in Machine learning. But I really do not understand how this Robot lawyer can work: A 19-year-old made a free robot lawyer that ...
1
vote
0answers
16 views

Reasoning approaches for implementing a Knowledge-based System?

What are the major approaches in implementing a Knowledge-based System (KBS)? Approaches used to take decisions in a KBS that I have come across so far are the case-based and rule-based reasoning ...
2
votes
1answer
38 views

What is a good example to illustrate the difference between isomorphic and homomorphic representations?

I am learning about "knowledge representation" in my intro to AI course and one of the key ideas has to do with isomorphic vs homomorphic representations. The examples I find when I google around are ...
4
votes
0answers
33 views

What is the difference between Cased-based Reasoning and Rule-based reasoning?

As stated here, Rule-based Reasoning systems are considered to be "old style" AI that uses rules prepared by humans - as opposed to Neural Networks where machine recognizes pattern i.e. acquires new ...
5
votes
1answer
50 views

Clarification of the definition of a POMDP

From what I understand, a $MDP=(G, A, P, R)$ (markov decision process) is represented as: A complete directed graph $G=(V, E)$ A set of actions $A_u$ for each vertex $u \in V$ A reward function $R$ ...
0
votes
2answers
29 views

What to do when the information gain on decision trees is 0 for all possible splits?

I just started studying decisions trees and I am trying to construct a tree for a training set which uses Status as the class label. I am using the misclassification error as measure of impurity. ...
1
vote
2answers
81 views

Program interpretation for static analysis

Are there any implementations, or even academic work, regarding an application capable of looking at code and inferring what the code actually intends to do? For example, we give it a program that ...
0
votes
0answers
31 views

Belief Propagation in Computer Vision

I am working on dense matching using DSP algorithm. They have used belief propagation to optimize their energy function? How do we do it? I mean how do we assign prior belief? Link: Deformable Spatial ...
4
votes
0answers
56 views

Flaw with Cross Entropy Error in Neural Networks

I've recently been working on creating a neural network to classify handwritten digits. I implemented 1-of-N encoding such that there are the same number of output nodes as possible digits (The ...
2
votes
1answer
69 views

Difference between heuristic-based searching and optimal path searching

I'm currently studying for an AI computer-science course. One thing is difficult for me to grasp and somewhat vaguely explained in my course-material: I understand that with search-methods like e.g. ...
5
votes
1answer
57 views

Explanation of the knowledge representation hypothesis (Brian Smith)

In 1982 Brian Smith proposed his Knowledge Representation Hypothesis: Any mechanically embodied intelligent process will be comprised of structural ingredients that we as external ...
2
votes
1answer
123 views

Can an artificial neural network convert from cartesian coordinates to polar coordinates?

Given cartesian coordinates $x$ and $y$ as input, can a neural network output $r$ and $\theta$, the equivalent polar coordinates? This would seem to require an approximation of the pythagorean ...
0
votes
1answer
88 views

Dynamic Learning (Machine Learning)

I have been given a task to dynamically learn the optimum value of a parameter in a Heuristics Filtering Algorithm used in a tool. The accuracy of the tool increase as the value of K in the ...
1
vote
0answers
39 views

Text data comparison

Okay lets say i have two data structures . two phone data for example containing their Name and spec ( cpu , ram , display etc ) . I want to check if these two phones are the same or not . Their names ...