Questions tagged [neural-network]

In machine learning and cognitive science, neural networks are a family of statistical learning models inspired by biological neural networks and are used to estimate or approximate functions that can depend on a large number of inputs and are generally unknown.

Filter by
Sorted by
Tagged with
4
votes
0answers
25 views

Constraining monotonicity in the loss function during training

I have a neural network that I am training on a loss function composed of two terms (i.e. loss = loss1 + loss2). Ideally, I would like for both ...
4
votes
1answer
42 views

Python implementation of Back Propagation Algorithm without bias

This program implements the back propagation algorithm of neural network with an example. Can we make it more efficient? ...
6
votes
1answer
495 views

Simple neural network in c++

I have implemented a neural network in C++. But I'm not sure whether my implementation is correct or not. My code of the implementation of neural networks given bellow. As an inexperienced programmer, ...
5
votes
1answer
44 views

Using Newton Method in a Neural Network/

I programmed a Neural Network to do binary classification in python, and during the backpropagation step I used Newton-Raphson's method for optimization. Any kind of feedback would be appreciated, but ...
3
votes
0answers
34 views

LSTM Model - Validation Accuracy is not changing

I am working on classification problem, My input data is labels and output expected data is labels Labels Count 1 94481 0 65181 2 60448 I have made ...
1
vote
0answers
104 views

C# Neural Network project

I'm writing a NeuralNetwork library, so everyone could use it and I'm wondering if I can optimize it even more. Here is my GitHub repo if you want to check the whole project (I recommend using the <...
1
vote
0answers
26 views

Lazy loading generator for training a Keras network

A common use for Keras LSTM layers is to generate text. There are many examples showing you how to do it. The usual method is to convert the text into a sequence of tokens and then slice up the ...
2
votes
1answer
63 views

MNIST Neural network in C++

While reading an online book (Michael A. Nielsen, Neural Networks and Deep Learning, Determination Press, 2015) regarding neural networks, I decided I wanted to try and build a neural network which ...
2
votes
0answers
34 views

simple neural network in python

I've spent the last few days learning the beginnings of how to implement a simple neural network. I've gone through chapters 1 and 2 of this book and have tried to write my own NN with referrals to ...
1
vote
0answers
28 views

A function for batch backpropagation of weight errors in a dense neural network layer

I'm switching my neural network library over to using ArrayFire for performance. One of the features I am losing moving from ndarray is ndarray_einsum_beta, as such I need to write my own function to ...
3
votes
1answer
29 views

Creating generator object with image augmentation to train Convolutional Neural Networks with Keras

I am currently self-studying on Python generator object and use it to generate training data and do augmentation on-the-fly, then feed it into Convolutional Neural Networks. Could anyone please help ...
0
votes
0answers
38 views

Python Max/Average Pooling Class

I am writing a simple module that performs CNN steps to get a deeper understanding of how it works. I have here written a class that performs average and max pooling to a given image ...
2
votes
0answers
79 views

Multi-threaded HD Image classifier using a neural network

This is a follow up to the code found here: Multithreaded HD Image Processing + Logistic reg. Classifier + Visualization Description: This code takes a label and a folder path of subfolders as ...
6
votes
2answers
163 views

A Neural Network

I programmed a Neural Network in python. Feedback every kind is appreciated. I tried to use some vectorization but it turned out to become quite a mess. Because you can't append to numpy arrays I ...
2
votes
1answer
75 views

Java Neural Network Implementation

I have recently tried to get a better grip on machine learning from a point of implementation - not statistics. I've read several explanations of an implementation of a Neural Network via pseudocode ...
1
vote
0answers
74 views

Neural network from scratch in Python

So after watching week 5 of the machine learning course on Coursera by Andrew Ng, I decided to write a simple neural net from scratch using Python. Here's my code: ...
-1
votes
1answer
67 views

Python ANN Implementation [closed]

I recently learned about backpropagation online and tried to implement it. I am not sure I have it correct yet. I am confused and would love a second pair of eyes on this code. Please help me ...
8
votes
0answers
126 views

Neural Network with Template Metaprogramming

I was implementing a simple neural network, and I noticed that, if I ever wanted to change the layers' activation functions, i would have had to completely rewrite some parts of the code, so I tried ...
6
votes
1answer
58 views

Implementation of perceptron, inspired by Rashka

I am trying to learn the basics about neural networks by coding from scratch the perceptron model. Since I am not a programmer and would like to improve my coding skills I would like to get your ...
8
votes
1answer
214 views

Deep Neural Net implementation in Python3

I created my first implementation of an arbitrary feed forward neural network with a simple back-propagation training implementation. ...
3
votes
0answers
665 views

A simple toy ResNet model and its implementation

I want to understand how resnet works also called us residual networks and I understand it better when I code one myself. I tried to find a simple implementation of resnet in the web but most I found ...
1
vote
0answers
72 views

Custom Vector and Matrix classes in python for machine learning

I am creating a machine learning tool set from scratch in python. I have never done something of this kind and I don't usually use python but I thought it would be good to expand my horizons. I am ...
4
votes
1answer
512 views

Artificial Neural Network Classifier in Matlab

I am trying to build a neural network classifier. I have created a neural network with 1 hidden layer (25 neurons) and 1 output layer (1 neuron/binary classification). The dataset I am using has the ...
2
votes
0answers
157 views

Simple Neural Network from scratch using NumPy (Python)

I added learning rate and momentum to a neural network implementation from scratch I found at: https://towardsdatascience.com/how-to-build-your-own-neural-network-from-scratch-in-python-68998a08e4f6 ...
2
votes
1answer
50 views

Haskell 'n' layered ANN forward pass

I'm trying to write a simple 'n' layered ANN in haskell for supervised learning, it will eventually have back prop and you'll be able to use it in a step by step fashion through a GUI which will graph ...
6
votes
1answer
85 views

Simple neural network implementation in Python

A simple neural network I wrote in Python without libraries. I avoided implementing it in matrix form because I sought to get a basic understanding of the way NN's work first. For that reason I'm ...
3
votes
2answers
122 views

How to make my neural network train faster

I'm trying to train my neural network and for the most part it's going well. However, I'd like it if it could train faster and was wondering if anyone could give some advice. I'm trying mostly to ...
1
vote
0answers
120 views

Neural Network Backpropagation

My neural network is buggy somewhere. However, the reason I am posting here and not Stack Overflow is because a buggy neural network can still be trained to some degree and will compile/perform better ...
1
vote
0answers
50 views

Move image files according to watermark identified by a neural networks

I have created a neural network that can identify watermarks and can classify them to which company do they belong. Now I created a script that will identify watermark from a folder and move them to ...
-2
votes
0answers
27 views

Move image files according to watermark identified by a neural network [duplicate]

I have created a neural network that can identify watermarks and can classify them to which company do they belong. Now I created a script that will identify watermark from a folder and move them to ...
2
votes
0answers
1k views

Logistic Regression using PyTorch

I want to get familiar with PyTorch and decided to implement a simple neural network that is essentially a logistic regression classifier to solve the Dogs vs. Cats problem. I move 5000 random ...
1
vote
0answers
83 views

Simple ANN (MLP) with C++. Synapses

Project I want to write a library that implements simple artificial neural network in C++. In this post I would like to discuss only a part of my project, namely connection between neurons: synapses. ...
4
votes
2answers
1k views

First Attempt at implementing a Perceptron

Here is an attempt at implementing the simplest Neural Network, which is an algorithm for learning a binary classifier. In this specific case, it can decide whether an input, of a pair of Cartesian ...
8
votes
1answer
158 views

Multi-layer perceptron program is super slow

I'm writing a multi-layer perceptron from scratch and I think it's way slower than it should be. the culprit seems to be my compute_gradients-function, which ...
3
votes
0answers
3k views

Simple Neural Network in C

A neural network is a structure of connections and nodes that takes input and generates an output. It can be "taught"(adjusting weights and biases of connections) from a teacher data set ...
7
votes
1answer
310 views

Deep Neural Network in Python

I have written a neural network in Python and focused on adaptability and performance. I want to use it to dive deeper into that field. I am far from being an expert in neural networks and the same ...
1
vote
0answers
120 views

Chainer - Python - Logistic Regression

I created a simple Logistic Regression model using Python and Chainer. I would like to optimize the code for which I like to get some help. One restriction: interchanging the implemented ...
5
votes
0answers
200 views

A Java neural network

I have created a neural network in Java, it contains multiple classes. I have uploaded the documentation for the network here: Doxygen, and the full source can be found on Github. Let me start out by ...
3
votes
0answers
180 views

Keras DDOS classification network only getting 89.6 percent detection

I've created a neural network that attempts to detect when a DDOS attack is happening but it only gets to 89.6% accuracy before plateauing. My code: ...
2
votes
0answers
3k views

Matlab Code for Convolutional Neural Networks

I am using Matlab to train a convolutional neural network to do a two class image classification problem. I have an imbalanced data set (~1800 images minority class, ~5000 images majority class). As I ...
1
vote
0answers
683 views

Back Propagation Implementation in Python for Deep Neural Network

I have coded Back Propagation algorithm for Deep neural network from scratch, which runs pretty fine. Gradient Check does not seem to produce any error, however, the cost does not seem to decrease, ...
4
votes
0answers
90 views

Artificial perceptron in python3 [closed]

I have designed a very basic perceptron (single layer neural network) that has been mostly successful in learning basic linearly separable problems. The perceptron in defined as a class with ...
6
votes
1answer
223 views

Self-written Neural Network

I created the following Neural Network in Python. It uses weights and biases which should follow standard procedure. ...
7
votes
1answer
208 views

Basic OCR using a 1-Layer Neural Network in Haskell

I've used this tutorial in order to learn the basics of creating a neural network from scratch. The program is meant to read handwritten numbers from the MNIST database. The author of the tutorial ...
3
votes
0answers
2k views

Python Neural Network for XOR

I have the following python code which implements a simple neural network (two inputs, one hidden layer with 2 neurons, and one output) with a sigmoid activation function to learn a XOR gate. The code ...
5
votes
0answers
699 views

Low accuracy of LSTM model tensorflow [closed]

I am trying to learn LSTM model for sentiment analysis using Tensorflow, I have gone through the LSTM model. Following code (create_sentiment_featuresets.py) generates the lexicon from 5000 positive ...
2
votes
0answers
301 views

Back-propagation code

So I wrote this code a while ago, but i'm trying to optimize my code. Is there anything that I should definitely change here to save memory/time? The code checks if the neuron is an output or hidden/...
4
votes
0answers
202 views

Simple Stateful LSTM example with arbitrary sequence length

I'm trying to make a simple example showing how to create a RNN with Keras that accepts as input a sequence of arbitrary length. In my example, the LSTM is trying to classify whether a sequence has ...
3
votes
2answers
6k views

(REALLY) simple neural network program

This is a simple program to create neural networks. It only includes weighting of connections and activation values for the neurons. It doesn't include any learning feature of any kind, and it is ...
8
votes
1answer
2k views

Speech Recognition Part 3: Training the Neural Network

The last part of my speech recognition series: finally training my network. Here's the dataset I did it with (self-generated, small I know), and the code I used. After running this code (takes ...