Questions tagged [neural-network]

In machine learning and cognitive science, neural networks are a family of statistical learning models inspired by biological neural networks and are used to estimate or approximate functions that can depend on a large number of inputs and are generally unknown.

Filter by
Sorted by
Tagged with
-1 votes
0 answers
14 views

im attempting to make a very crude neural network, and im having trouble with OOP [closed]

...
user avatar
0 votes
0 answers
31 views

MNIST classifier and autoencoder: 2 in 1 deal

I built an autoencoder with a latent space of dimension 10 that doubles as a classifier (the predicted digit is the argmax of the latent space). This was obtained by optimizing both the digit ...
user avatar
  • 27.2k
0 votes
0 answers
25 views

Recurrent neural network producing the same output for all predictions

I've been trying to create a toxic comment 'rater' from this Kaggle challenge. The training data consists of a number of comments with scorers on whether it was toxic, severely toxic, obscene, a ...
user avatar
  • 151
1 vote
0 answers
60 views

Binary classification with pytorch

I wrote a simple neural network binary classification algorithm using Pytorch. It uses the dataset from https://www.kaggle.com/pritsheta/heart-attack, which consists of a table with 300 rows and 14 ...
user avatar
4 votes
1 answer
56 views

Unsupervised competitive learning algorithm from scratch in javascript

I'm a mathematician who is new to programming and I'm currently reading the book "Theory of Neural Networks" by Rojas. To become better, I try to program every algorithm that is described in ...
user avatar
2 votes
0 answers
32 views

DQN implementation

I just wrote my pong DQN. It seems to work. I'm looking for a performance based review on anything that might slow down the training in complex models. main.py: ...
user avatar
0 votes
0 answers
16 views

Neural Network class in python

Is the following a proper way to write a class using Keras and TensorFlow to train a neural network? ...
user avatar
2 votes
2 answers
73 views

Updated version of my first neural network in c++

I got lot of suggestions for optimizing my neural network last post I made, now I wanted to post updated version of it were I got rid of most of performance eaters, now I would really appriciate ...
user avatar
  • 31
8 votes
3 answers
708 views

My first functional naive neural network in C++

I just wrote my first standard neural network with SGD gradient descent in c++, I am really interested if I have done anything wrong or inefficient, suggestions would help me a ton (There is lots of ...
user avatar
2 votes
1 answer
67 views

Loss function in python is a bit cumbersome

This is my first post here. I seek to improve my way of writing Python and C++ code. I hope I can also contribute to others when I have increased my skill. Here is a python function I have for a ...
user avatar
  • 169
4 votes
1 answer
89 views

Working Neural Net from scratch

Asking for a review of this neural network code. I have officially finished my first neural net that works properly (by my standards right now). But I know there is more than likely some details I am ...
user avatar
5 votes
0 answers
78 views

Neural Network Written in Python is Extremely Slow

I coded a basic feedforward neural network with all pure python with the exception of numpy in order to better understand how neural networks work. It works, but the only problem is it is extremely ...
user avatar
1 vote
1 answer
125 views

Neural net backprop code quality

This is my first neural net, previously I had it with just one hidden layer. I have now given it an adjustable number of hidden layers. It all works perfectly (asin I dont get nans and infs). I have ...
user avatar
1 vote
1 answer
71 views

Does this feedforward neural network work like i think it works?

I seem to have taught myself the basics of c++ living off grig in the woods of Alaska. Most of this has been done on my android phone using cpp droid. This is the first time anyone has seen any of my ...
user avatar
4 votes
0 answers
83 views

Using VAE for reconstructing images

Article: https://arxiv.org/pdf/2009.07047v1.pdf Full Code: https://colab.research.google.com/drive/1KZZuIa7Lk13ImZLJ3b-kxMfcveOPaWvN#scrollTo=XhdMfBFtzaEH Dataset: https://drive.google.com/file/d/...
user avatar
  • 41
2 votes
0 answers
46 views

Generator and Encoder network model [closed]

https://arxiv.org/pdf/2009.07047v1.pdf I don't have a lot of experience in building a network model. I would like to build the Encoder and ...
user avatar
  • 121
1 vote
0 answers
71 views

Implementing Convolutional Neural Network

Context I was making a Convolutional Neural Network from scratch in Python. I completed making it .... It works fine ... The only thing is that it takes a lot of time as the size of the input grows. ...
user avatar
7 votes
1 answer
112 views

A .py utility file for neural network learing rate policies

I've created a .py utility file, which specifies the learning rate policy for the neural network in PyTorch. The program in prior reads a ...
user avatar
3 votes
0 answers
62 views

Constraining monotonicity in the loss function during training

I have a neural network that I am training on a loss function composed of two terms (i.e. loss = loss1 + loss2). Ideally, I would like for both ...
user avatar
  • 131
4 votes
1 answer
54 views

Python implementation of Back Propagation Algorithm without bias

This program implements the back propagation algorithm of neural network with an example. Can we make it more efficient? ...
user avatar
6 votes
1 answer
841 views

Simple neural network in c++

I have implemented a neural network in C++. But I'm not sure whether my implementation is correct or not. My code of the implementation of neural networks given bellow. As an inexperienced programmer, ...
user avatar
6 votes
1 answer
135 views

Using Newton Method in a Neural Network/

I programmed a Neural Network to do binary classification in python, and during the backpropagation step I used Newton-Raphson's method for optimization. Any kind of feedback would be appreciated, but ...
user avatar
1 vote
1 answer
84 views

LSTM Model - Validation Accuracy is not changing

I am working on classification problem, My input data is labels and output expected data is labels Labels Count 1 94481 0 65181 2 60448 I have made ...
user avatar
0 votes
0 answers
145 views

C# Neural Network project

I'm writing a NeuralNetwork library, so everyone could use it and I'm wondering if I can optimize it even more. Here is my GitHub repo if you want to check the whole project (I recommend using the <...
user avatar
1 vote
0 answers
164 views

Lazy loading generator for training a Keras network

A common use for Keras LSTM layers is to generate text. There are many examples showing you how to do it. The usual method is to convert the text into a sequence of tokens and then slice up the ...
user avatar
3 votes
1 answer
454 views

MNIST Neural network in C++

While reading an online book (Michael A. Nielsen, Neural Networks and Deep Learning, Determination Press, 2015) regarding neural networks, I decided I wanted to try and build a neural network which ...
user avatar
  • 33
2 votes
0 answers
45 views

simple neural network in python

I've spent the last few days learning the beginnings of how to implement a simple neural network. I've gone through chapters 1 and 2 of this book and have tried to write my own NN with referrals to ...
user avatar
  • 61
1 vote
0 answers
48 views

A function for batch backpropagation of weight errors in a dense neural network layer

I'm switching my neural network library over to using ArrayFire for performance. One of the features I am losing moving from ndarray is ndarray_einsum_beta, as such I need to write my own function to ...
user avatar
3 votes
1 answer
34 views

Creating generator object with image augmentation to train Convolutional Neural Networks with Keras

I am currently self-studying on Python generator object and use it to generate training data and do augmentation on-the-fly, then feed it into Convolutional Neural Networks. Could anyone please help ...
user avatar
  • 131
2 votes
0 answers
90 views

Multi-threaded HD Image classifier using a neural network

This is a follow up to the code found here: Multithreaded HD Image Processing + Logistic reg. Classifier + Visualization Description: This code takes a label and a folder path of subfolders as ...
user avatar
6 votes
2 answers
187 views

A Neural Network

I programmed a Neural Network in python. Feedback every kind is appreciated. I tried to use some vectorization but it turned out to become quite a mess. Because you can't append to numpy arrays I ...
user avatar
  • 163
2 votes
1 answer
85 views

Java Neural Network Implementation

I have recently tried to get a better grip on machine learning from a point of implementation - not statistics. I've read several explanations of an implementation of a Neural Network via pseudocode ...
user avatar
1 vote
0 answers
92 views

Neural network from scratch in Python

So after watching week 5 of the machine learning course on Coursera by Andrew Ng, I decided to write a simple neural net from scratch using Python. Here's my code: ...
user avatar
-1 votes
1 answer
99 views

Python ANN Implementation [closed]

I recently learned about backpropagation online and tried to implement it. I am not sure I have it correct yet. I am confused and would love a second pair of eyes on this code. Please help me ...
user avatar
9 votes
1 answer
253 views

Neural Network with Template Metaprogramming

I was implementing a simple neural network, and I noticed that, if I ever wanted to change the layers' activation functions, i would have had to completely rewrite some parts of the code, so I tried ...
user avatar
  • 633
6 votes
1 answer
74 views

Implementation of perceptron, inspired by Rashka

I am trying to learn the basics about neural networks by coding from scratch the perceptron model. Since I am not a programmer and would like to improve my coding skills I would like to get your ...
user avatar
  • 103
8 votes
1 answer
229 views

Deep Neural Net implementation in Python3

I created my first implementation of an arbitrary feed forward neural network with a simple back-propagation training implementation. ...
user avatar
3 votes
0 answers
1k views

A simple toy ResNet model and its implementation

I want to understand how resnet works also called us residual networks and I understand it better when I code one myself. I tried to find a simple implementation of resnet in the web but most I found ...
user avatar
  • 349
1 vote
0 answers
249 views

Custom Vector and Matrix classes in python for machine learning

I am creating a machine learning tool set from scratch in python. I have never done something of this kind and I don't usually use python but I thought it would be good to expand my horizons. I am ...
user avatar
4 votes
1 answer
715 views

Artificial Neural Network Classifier in Matlab

I am trying to build a neural network classifier. I have created a neural network with 1 hidden layer (25 neurons) and 1 output layer (1 neuron/binary classification). The dataset I am using has the ...
user avatar
  • 183
2 votes
0 answers
188 views

Simple Neural Network from scratch using NumPy (Python)

I added learning rate and momentum to a neural network implementation from scratch I found at: https://towardsdatascience.com/how-to-build-your-own-neural-network-from-scratch-in-python-68998a08e4f6 ...
user avatar
2 votes
1 answer
57 views

Haskell 'n' layered ANN forward pass

I'm trying to write a simple 'n' layered ANN in haskell for supervised learning, it will eventually have back prop and you'll be able to use it in a step by step fashion through a GUI which will graph ...
user avatar
6 votes
1 answer
105 views

Simple neural network implementation in Python

A simple neural network I wrote in Python without libraries. I avoided implementing it in matrix form because I sought to get a basic understanding of the way NN's work first. For that reason I'm ...
user avatar
  • 121
3 votes
2 answers
193 views

How to make my neural network train faster

I'm trying to train my neural network and for the most part it's going well. However, I'd like it if it could train faster and was wondering if anyone could give some advice. I'm trying mostly to ...
user avatar
  • 35
2 votes
0 answers
141 views

Neural Network Backpropagation

My neural network is buggy somewhere. However, the reason I am posting here and not Stack Overflow is because a buggy neural network can still be trained to some degree and will compile/perform better ...
user avatar
1 vote
0 answers
59 views

Move image files according to watermark identified by a neural networks

I have created a neural network that can identify watermarks and can classify them to which company do they belong. Now I created a script that will identify watermark from a folder and move them to ...
user avatar
  • 111
-2 votes
0 answers
31 views

Move image files according to watermark identified by a neural network [duplicate]

I have created a neural network that can identify watermarks and can classify them to which company do they belong. Now I created a script that will identify watermark from a folder and move them to ...
user avatar
2 votes
0 answers
1k views

Logistic Regression using PyTorch

I want to get familiar with PyTorch and decided to implement a simple neural network that is essentially a logistic regression classifier to solve the Dogs vs. Cats problem. I move 5000 random ...
user avatar
1 vote
0 answers
94 views

Simple ANN (MLP) with C++. Synapses

Project I want to write a library that implements simple artificial neural network in C++. In this post I would like to discuss only a part of my project, namely connection between neurons: synapses. ...
user avatar
  • 771
4 votes
2 answers
1k views

First Attempt at implementing a Perceptron

Here is an attempt at implementing the simplest Neural Network, which is an algorithm for learning a binary classifier. In this specific case, it can decide whether an input, of a pair of Cartesian ...
user avatar
  • 1,144