Skip to main content

Questions tagged [neural-network]

In machine learning and cognitive science, neural networks are a family of statistical learning models inspired by biological neural networks and are used to estimate or approximate functions that can depend on a large number of inputs and are generally unknown.

Filter by
Sorted by
Tagged with
2 votes
1 answer
34 views

One-layer linear neural network to solve a regression problem in PyTorch

Good morning everyone, I am trying to figure out how deep learning works. My approach is mainly theoretical but I have decided to code a few deep learning projects to get a better feel of the kind of ...
francescoriccardocrescenzi's user avatar
1 vote
1 answer
105 views

Custom neural network implementation in TensorFlow to compare normalisation vs. no normalisation on data

I am performing a sports prediction multi-class classification problem, and wanted to compare the differences in model performance between normalised and non-normalised data. You can see the 2 ...
pastybake2002's user avatar
0 votes
0 answers
32 views

Simple Feed Forward Neural Network with no backpropagation yet

The following code is code I wrote in c for a simple neural network with no backpropagation implementation yet. All the header files were put in one file because I am using visual studio which does ...
Christian Phillips's user avatar
2 votes
0 answers
34 views

A simple word embedder only using jax

How can this code be improved? I'm a novice programmer trying to learn ml by doing it from scratch. This code is part of a transformer model that I'm working on. Do you have any ideas about how to ...
T3st's user avatar
  • 21
1 vote
0 answers
112 views

Convolutional Neural Network (CNN) in Julia

I wrote an n-dimensional convolutional neural network from scratch in Julia (check out the GitLab repo or the GitHub repo). It implements the following layer types: ...
Andy Sukowski-Bang's user avatar
0 votes
0 answers
54 views

Running a neural network backwards

I've read this paper where they basically run a network backwards. And decided to try. Luckily, many useful functions are implemented already in pytorch. The main idea is this: Write a convnet Write ...
Minsky's user avatar
  • 249
1 vote
0 answers
47 views

Recurrent Neural Network loss is NAN

I am training a neural network to use approximately 600 features (4103rd to last column of a df) to predict approximately 4000 values (7th to 4102nd column of the same df). I have standardized the ...
Manas Garg's user avatar
6 votes
3 answers
576 views

Feed forward neural network

I have made a basic neural network in python. The idea is the neural network can have any structure you want, not just the standard layers where every neuron is connected to every neuron in the next ...
coder's user avatar
  • 179
2 votes
1 answer
131 views

ANN with Backpropagation for MINST data set

I am learning about ANN and tried it for the MINST data sets. Now I am supposted to create a neural network (ANN) with backpropagation. The structure for the neural network I have is this the input ...
zellez11's user avatar
1 vote
1 answer
90 views

Neural Network in Julia (Multilayer Perceptron)

I wrote a simple multilayer perceptron in Julia, which seems to work fine on different datasets, e.g. the MNIST dataset with a success rate of about 90% after a few seconds of training. But I would ...
Andy Sukowski-Bang's user avatar
1 vote
1 answer
62 views

Optimize an algorithm for preparing a dataset for machine learning

I'm learning how to use R coming from a python background. I'm following Andrej Karpathy's zero-to-hero course, reimplementing it in R. We start with a list of 32033 names. These names have to be ...
plaffont's user avatar
2 votes
1 answer
79 views

Readable Backprogragation calculations in Numpy Neural Network

As an exercise we should write a small Neural Network with the following structure: There should be additionally a bias for each layer and sigmoid should be used as the activation function. The ...
Leon0402's user avatar
2 votes
0 answers
82 views

neural network that determines the gender of a word

I wrote a neural network in python using pytorch, which determines the gender of a word in Russian. As a training set: a file containing a word and a number from 0 to 2 (0-masculine,1- feminine and 2-...
Андрей С.'s user avatar
1 vote
0 answers
151 views

Binary classification with pytorch

I wrote a simple neural network binary classification algorithm using Pytorch. It uses the dataset from https://www.kaggle.com/pritsheta/heart-attack, which consists of a table with 300 rows and 14 ...
user3053216's user avatar
4 votes
1 answer
76 views

Unsupervised competitive learning algorithm from scratch in javascript

I'm a mathematician who is new to programming and I'm currently reading the book "Theory of Neural Networks" by Rojas. To become better, I try to program every algorithm that is described in ...
Giuliano Cantina's user avatar
2 votes
0 answers
53 views

DQN implementation

I just wrote my pong DQN. It seems to work. I'm looking for a performance based review on anything that might slow down the training in complex models. main.py: ...
Machine Learning Diary's user avatar
2 votes
2 answers
87 views

Updated version of my first neural network in c++

I got lot of suggestions for optimizing my neural network last post I made, now I wanted to post updated version of it were I got rid of most of performance eaters, now I would really appriciate ...
G.Azma's user avatar
  • 31
8 votes
3 answers
739 views

My first functional naive neural network in C++

I just wrote my first standard neural network with SGD gradient descent in c++, I am really interested if I have done anything wrong or inefficient, suggestions would help me a ton (There is lots of ...
NameThatDisplays's user avatar
2 votes
1 answer
99 views

Loss function in python is a bit cumbersome

Here is a python function I have for a neural network I have implemented. I feel it become a bit cumbersome. The intention is to weight positive labels in channels ...
El_Loco's user avatar
  • 169
4 votes
1 answer
119 views

Working Neural Net from scratch

Asking for a review of this neural network code. I have officially finished my first neural net that works properly (by my standards right now). But I know there is more than likely some details I am ...
Yugenswitch's user avatar
4 votes
1 answer
134 views

Neural Network Written in Python is Extremely Slow

I coded a basic feedforward neural network with all pure python with the exception of numpy in order to better understand how neural networks work. It works, but the only problem is it is extremely ...
Lburris12's user avatar
1 vote
1 answer
136 views

Neural net backprop code quality

This is my first neural net, previously I had it with just one hidden layer. I have now given it an adjustable number of hidden layers. It all works perfectly (asin I dont get nans and infs). I have ...
Yugenswitch's user avatar
1 vote
1 answer
76 views

Does this feedforward neural network work like i think it works?

I seem to have taught myself the basics of c++ living off grig in the woods of Alaska. Most of this has been done on my android phone using cpp droid. This is the first time anyone has seen any of my ...
Off_grid_coder's user avatar
4 votes
0 answers
99 views

Using VAE for reconstructing images

Article: https://arxiv.org/pdf/2009.07047v1.pdf Full Code: https://colab.research.google.com/drive/1KZZuIa7Lk13ImZLJ3b-kxMfcveOPaWvN#scrollTo=XhdMfBFtzaEH Dataset: https://drive.google.com/file/d/...
Robert's user avatar
  • 41
2 votes
0 answers
48 views

Generator and Encoder network model [closed]

https://arxiv.org/pdf/2009.07047v1.pdf I don't have a lot of experience in building a network model. I would like to build the Encoder and ...
Alex's user avatar
  • 121
1 vote
0 answers
80 views

Implementing Convolutional Neural Network

Context I was making a Convolutional Neural Network from scratch in Python. I completed making it .... It works fine ... The only thing is that it takes a lot of time as the size of the input grows. ...
NITIN AGARWAL's user avatar
7 votes
1 answer
114 views

A .py utility file for neural network learing rate policies

I've created a .py utility file, which specifies the learning rate policy for the neural network in PyTorch. The program in prior reads a ...
spiridon_the_sun_rotator's user avatar
3 votes
1 answer
101 views

Constraining monotonicity in the loss function during training

I have a neural network that I am training on a loss function composed of two terms (i.e. loss = loss1 + loss2). Ideally, I would like for both ...
Mathews24's user avatar
  • 131
4 votes
1 answer
65 views

Python implementation of Back Propagation Algorithm without bias

This program implements the back propagation algorithm of neural network with an example. Can we make it more efficient? ...
An student's user avatar
6 votes
1 answer
994 views

Simple neural network in c++

I have implemented a neural network in C++. But I'm not sure whether my implementation is correct or not. My code of the implementation of neural networks given bellow. As an inexperienced programmer, ...
Sharif Hasan's user avatar
6 votes
1 answer
256 views

Using Newton Method in a Neural Network/

I programmed a Neural Network to do binary classification in python, and during the backpropagation step I used Newton-Raphson's method for optimization. Any kind of feedback would be appreciated, but ...
Bagutreko's user avatar
1 vote
1 answer
123 views

LSTM Model - Validation Accuracy is not changing

I am working on classification problem, My input data is labels and output expected data is labels Labels Count 1 94481 0 65181 2 60448 I have made ...
YogeshKumar's user avatar
1 vote
0 answers
282 views

Lazy loading generator for training a Keras network

A common use for Keras LSTM layers is to generate text. There are many examples showing you how to do it. The usual method is to convert the text into a sequence of tokens and then slice up the ...
Gaslight Deceive Subvert's user avatar
3 votes
1 answer
913 views

MNIST Neural network in C++

While reading an online book (Michael A. Nielsen, Neural Networks and Deep Learning, Determination Press, 2015) regarding neural networks, I decided I wanted to try and build a neural network which ...
rvdb's user avatar
  • 33
2 votes
0 answers
52 views

simple neural network in python

I've spent the last few days learning the beginnings of how to implement a simple neural network. I've gone through chapters 1 and 2 of this book and have tried to write my own NN with referrals to ...
andy's user avatar
  • 61
1 vote
0 answers
54 views

A function for batch backpropagation of weight errors in a dense neural network layer

I'm switching my neural network library over to using ArrayFire for performance. One of the features I am losing moving from ndarray is ndarray_einsum_beta, as such I need to write my own function to ...
Jonathan Woollett-light's user avatar
3 votes
1 answer
36 views

Creating generator object with image augmentation to train Convolutional Neural Networks with Keras

I am currently self-studying on Python generator object and use it to generate training data and do augmentation on-the-fly, then feed it into Convolutional Neural Networks. Could anyone please help ...
eng2019's user avatar
  • 131
2 votes
0 answers
111 views

Multi-threaded HD Image classifier using a neural network

This is a follow up to the code found here: Multithreaded HD Image Processing + Logistic reg. Classifier + Visualization Description: This code takes a label and a folder path of subfolders as ...
watch-this's user avatar
6 votes
2 answers
219 views

A Neural Network

I programmed a Neural Network in python. Feedback every kind is appreciated. I tried to use some vectorization but it turned out to become quite a mess. Because you can't append to numpy arrays I ...
Lupos's user avatar
  • 163
2 votes
1 answer
94 views

Java Neural Network Implementation

I have recently tried to get a better grip on machine learning from a point of implementation - not statistics. I've read several explanations of an implementation of a Neural Network via pseudocode ...
Edwin Carlsson's user avatar
1 vote
0 answers
99 views

Neural network from scratch in Python

So after watching week 5 of the machine learning course on Coursera by Andrew Ng, I decided to write a simple neural net from scratch using Python. Here's my code: ...
user avatar
-1 votes
1 answer
130 views

Python ANN Implementation [closed]

I recently learned about backpropagation online and tried to implement it. I am not sure I have it correct yet. I am confused and would love a second pair of eyes on this code. Please help me ...
need_help_pls's user avatar
9 votes
1 answer
357 views

Neural Network with Template Metaprogramming

I was implementing a simple neural network, and I noticed that, if I ever wanted to change the layers' activation functions, i would have had to completely rewrite some parts of the code, so I tried ...
Dan Dan's user avatar
  • 633
6 votes
1 answer
83 views

Implementation of perceptron, inspired by Rashka

I am trying to learn the basics about neural networks by coding from scratch the perceptron model. Since I am not a programmer and would like to improve my coding skills I would like to get your ...
amous's user avatar
  • 103
8 votes
1 answer
247 views

Deep Neural Net implementation in Python3

I created my first implementation of an arbitrary feed forward neural network with a simple back-propagation training implementation. ...
Display name's user avatar
3 votes
0 answers
1k views

A simple toy ResNet model and its implementation

I want to understand how resnet works also called us residual networks and I understand it better when I code one myself. I tried to find a simple implementation of resnet in the web but most I found ...
Eka's user avatar
  • 349
1 vote
0 answers
313 views

Custom Vector and Matrix classes in python for machine learning

I am creating a machine learning tool set from scratch in python. I have never done something of this kind and I don't usually use python but I thought it would be good to expand my horizons. I am ...
robert gibson's user avatar
4 votes
1 answer
795 views

Artificial Neural Network Classifier in Matlab

I am trying to build a neural network classifier. I have created a neural network with 1 hidden layer (25 neurons) and 1 output layer (1 neuron/binary classification). The dataset I am using has the ...
U. User's user avatar
  • 193
2 votes
0 answers
199 views

Simple Neural Network from scratch using NumPy (Python)

I added learning rate and momentum to a neural network implementation from scratch I found at: https://towardsdatascience.com/how-to-build-your-own-neural-network-from-scratch-in-python-68998a08e4f6 ...
Seb Squire's user avatar
2 votes
1 answer
63 views

Haskell 'n' layered ANN forward pass

I'm trying to write a simple 'n' layered ANN in haskell for supervised learning, it will eventually have back prop and you'll be able to use it in a step by step fashion through a GUI which will graph ...
Thomas Cook's user avatar