We changed our privacy policy. Read more.

Questions tagged [neural-network]

In machine learning and cognitive science, neural networks are a family of statistical learning models inspired by biological neural networks and are used to estimate or approximate functions that can depend on a large number of inputs and are generally unknown.

Filter by
Sorted by
Tagged with
2
votes
0answers
22 views

Unsupervised competitive learning algorithm from scratch in javascript

I'm a mathematician who is new to programming and I'm currently reading the book "Theory of Neural Networks" by Rojas. To become better, I try to program every algorithm that is described in ...
2
votes
0answers
19 views

DQN implementation

I just wrote my pong DQN. It seems to work. I'm looking for a performance based review on anything that might slow down the training in complex models. main.py: ...
0
votes
0answers
14 views

Neural Network class in python

Is the following a proper way to write a class using Keras and TensorFlow to train a neural network? ...
2
votes
2answers
67 views

Updated version of my first neural network in c++

I got lot of suggestions for optimizing my neural network last post I made, now I wanted to post updated version of it were I got rid of most of performance eaters, now I would really appriciate ...
8
votes
3answers
683 views

My first functional naive neural network in C++

I just wrote my first standard neural network with SGD gradient descent in c++, I am really interested if I have done anything wrong or inefficient, suggestions would help me a ton (There is lots of ...
1
vote
1answer
42 views

Loss function in python is a bit cumbersome

This is my first post here. I seek to improve my way of writing Python and C++ code. I hope I can also contribute to others when I have increased my skill. Here is a python function I have for a ...
5
votes
1answer
80 views

Working Neural Net from scratch

Asking for a review of this neural network code. I have officially finished my first neural net that works properly (by my standards right now). But I know there is more than likely some details I am ...
5
votes
0answers
67 views

Neural Network Written in Python is Extremely Slow

I coded a basic feedforward neural network with all pure python with the exception of numpy in order to better understand how neural networks work. It works, but the only problem is it is extremely ...
1
vote
1answer
123 views

Neural net backprop code quality

This is my first neural net, previously I had it with just one hidden layer. I have now given it an adjustable number of hidden layers. It all works perfectly (asin I dont get nans and infs). I have ...
2
votes
1answer
63 views

Does this feedforward neural network work like i think it works?

I seem to have taught myself the basics of c++ living off grig in the woods of Alaska. Most of this has been done on my android phone using cpp droid. This is the first time anyone has seen any of my ...
4
votes
0answers
70 views

Using VAE for reconstructing images

Article: https://arxiv.org/pdf/2009.07047v1.pdf Full Code: https://colab.research.google.com/drive/1KZZuIa7Lk13ImZLJ3b-kxMfcveOPaWvN#scrollTo=XhdMfBFtzaEH Dataset: https://drive.google.com/file/d/...
2
votes
0answers
46 views

Generator and Encoder network model [closed]

https://arxiv.org/pdf/2009.07047v1.pdf I don't have a lot of experience in building a network model. I would like to build the Encoder and ...
1
vote
0answers
68 views

Implementing Convolutional Neural Network

Context I was making a Convolutional Neural Network from scratch in Python. I completed making it .... It works fine ... The only thing is that it takes a lot of time as the size of the input grows. ...
7
votes
1answer
109 views

A .py utility file for neural network learing rate policies

I've created a .py utility file, which specifies the learning rate policy for the neural network in PyTorch. The program in prior reads a ...
4
votes
0answers
54 views

Constraining monotonicity in the loss function during training

I have a neural network that I am training on a loss function composed of two terms (i.e. loss = loss1 + loss2). Ideally, I would like for both ...
4
votes
1answer
49 views

Python implementation of Back Propagation Algorithm without bias

This program implements the back propagation algorithm of neural network with an example. Can we make it more efficient? ...
6
votes
1answer
771 views

Simple neural network in c++

I have implemented a neural network in C++. But I'm not sure whether my implementation is correct or not. My code of the implementation of neural networks given bellow. As an inexperienced programmer, ...
6
votes
1answer
68 views

Using Newton Method in a Neural Network/

I programmed a Neural Network to do binary classification in python, and during the backpropagation step I used Newton-Raphson's method for optimization. Any kind of feedback would be appreciated, but ...
2
votes
1answer
67 views

LSTM Model - Validation Accuracy is not changing

I am working on classification problem, My input data is labels and output expected data is labels Labels Count 1 94481 0 65181 2 60448 I have made ...
1
vote
0answers
138 views

C# Neural Network project

I'm writing a NeuralNetwork library, so everyone could use it and I'm wondering if I can optimize it even more. Here is my GitHub repo if you want to check the whole project (I recommend using the <...
1
vote
0answers
100 views

Lazy loading generator for training a Keras network

A common use for Keras LSTM layers is to generate text. There are many examples showing you how to do it. The usual method is to convert the text into a sequence of tokens and then slice up the ...
3
votes
1answer
279 views

MNIST Neural network in C++

While reading an online book (Michael A. Nielsen, Neural Networks and Deep Learning, Determination Press, 2015) regarding neural networks, I decided I wanted to try and build a neural network which ...
2
votes
0answers
38 views

simple neural network in python

I've spent the last few days learning the beginnings of how to implement a simple neural network. I've gone through chapters 1 and 2 of this book and have tried to write my own NN with referrals to ...
1
vote
0answers
42 views

A function for batch backpropagation of weight errors in a dense neural network layer

I'm switching my neural network library over to using ArrayFire for performance. One of the features I am losing moving from ndarray is ndarray_einsum_beta, as such I need to write my own function to ...
3
votes
1answer
29 views

Creating generator object with image augmentation to train Convolutional Neural Networks with Keras

I am currently self-studying on Python generator object and use it to generate training data and do augmentation on-the-fly, then feed it into Convolutional Neural Networks. Could anyone please help ...
2
votes
0answers
83 views

Multi-threaded HD Image classifier using a neural network

This is a follow up to the code found here: Multithreaded HD Image Processing + Logistic reg. Classifier + Visualization Description: This code takes a label and a folder path of subfolders as ...
6
votes
2answers
181 views

A Neural Network

I programmed a Neural Network in python. Feedback every kind is appreciated. I tried to use some vectorization but it turned out to become quite a mess. Because you can't append to numpy arrays I ...
2
votes
1answer
79 views

Java Neural Network Implementation

I have recently tried to get a better grip on machine learning from a point of implementation - not statistics. I've read several explanations of an implementation of a Neural Network via pseudocode ...
1
vote
0answers
87 views

Neural network from scratch in Python

So after watching week 5 of the machine learning course on Coursera by Andrew Ng, I decided to write a simple neural net from scratch using Python. Here's my code: ...
-1
votes
1answer
83 views

Python ANN Implementation [closed]

I recently learned about backpropagation online and tried to implement it. I am not sure I have it correct yet. I am confused and would love a second pair of eyes on this code. Please help me ...
8
votes
1answer
202 views

Neural Network with Template Metaprogramming

I was implementing a simple neural network, and I noticed that, if I ever wanted to change the layers' activation functions, i would have had to completely rewrite some parts of the code, so I tried ...
6
votes
1answer
67 views

Implementation of perceptron, inspired by Rashka

I am trying to learn the basics about neural networks by coding from scratch the perceptron model. Since I am not a programmer and would like to improve my coding skills I would like to get your ...
8
votes
1answer
221 views

Deep Neural Net implementation in Python3

I created my first implementation of an arbitrary feed forward neural network with a simple back-propagation training implementation. ...
3
votes
0answers
921 views

A simple toy ResNet model and its implementation

I want to understand how resnet works also called us residual networks and I understand it better when I code one myself. I tried to find a simple implementation of resnet in the web but most I found ...
1
vote
0answers
185 views

Custom Vector and Matrix classes in python for machine learning

I am creating a machine learning tool set from scratch in python. I have never done something of this kind and I don't usually use python but I thought it would be good to expand my horizons. I am ...
4
votes
1answer
635 views

Artificial Neural Network Classifier in Matlab

I am trying to build a neural network classifier. I have created a neural network with 1 hidden layer (25 neurons) and 1 output layer (1 neuron/binary classification). The dataset I am using has the ...
2
votes
0answers
184 views

Simple Neural Network from scratch using NumPy (Python)

I added learning rate and momentum to a neural network implementation from scratch I found at: https://towardsdatascience.com/how-to-build-your-own-neural-network-from-scratch-in-python-68998a08e4f6 ...
2
votes
1answer
52 views

Haskell 'n' layered ANN forward pass

I'm trying to write a simple 'n' layered ANN in haskell for supervised learning, it will eventually have back prop and you'll be able to use it in a step by step fashion through a GUI which will graph ...
6
votes
1answer
95 views

Simple neural network implementation in Python

A simple neural network I wrote in Python without libraries. I avoided implementing it in matrix form because I sought to get a basic understanding of the way NN's work first. For that reason I'm ...
3
votes
2answers
165 views

How to make my neural network train faster

I'm trying to train my neural network and for the most part it's going well. However, I'd like it if it could train faster and was wondering if anyone could give some advice. I'm trying mostly to ...
2
votes
0answers
133 views

Neural Network Backpropagation

My neural network is buggy somewhere. However, the reason I am posting here and not Stack Overflow is because a buggy neural network can still be trained to some degree and will compile/perform better ...
1
vote
0answers
57 views

Move image files according to watermark identified by a neural networks

I have created a neural network that can identify watermarks and can classify them to which company do they belong. Now I created a script that will identify watermark from a folder and move them to ...
-2
votes
0answers
28 views

Move image files according to watermark identified by a neural network [duplicate]

I have created a neural network that can identify watermarks and can classify them to which company do they belong. Now I created a script that will identify watermark from a folder and move them to ...
2
votes
0answers
1k views

Logistic Regression using PyTorch

I want to get familiar with PyTorch and decided to implement a simple neural network that is essentially a logistic regression classifier to solve the Dogs vs. Cats problem. I move 5000 random ...
1
vote
0answers
92 views

Simple ANN (MLP) with C++. Synapses

Project I want to write a library that implements simple artificial neural network in C++. In this post I would like to discuss only a part of my project, namely connection between neurons: synapses. ...
4
votes
2answers
1k views

First Attempt at implementing a Perceptron

Here is an attempt at implementing the simplest Neural Network, which is an algorithm for learning a binary classifier. In this specific case, it can decide whether an input, of a pair of Cartesian ...
8
votes
1answer
192 views

Multi-layer perceptron program is super slow

I'm writing a multi-layer perceptron from scratch and I think it's way slower than it should be. the culprit seems to be my compute_gradients-function, which ...
4
votes
0answers
5k views

Simple Neural Network in C

A neural network is a structure of connections and nodes that takes input and generates an output. It can be "taught"(adjusting weights and biases of connections) from a teacher data set ...
7
votes
1answer
321 views

Deep Neural Network in Python

I have written a neural network in Python and focused on adaptability and performance. I want to use it to dive deeper into that field. I am far from being an expert in neural networks and the same ...
1
vote
0answers
123 views

Chainer - Python - Logistic Regression

I created a simple Logistic Regression model using Python and Chainer. I would like to optimize the code for which I like to get some help. One restriction: interchanging the implemented ...