Questions tagged [numpy]
NumPy is the fundamental package for scientific computing with the programming language Python.
572
questions
2
votes
1answer
42 views
Asteroids using pygame
I made the looks of asteroids using pygame. I still need to implement collisions but since it is running incredibly slow with 'amount' anything above 10. Please rip ...
1
vote
0answers
23 views
Python Implementation of Canopy Structural Dynamic Model using scipy.optimize.least_squares
I am using the least_squares() function from the scipy.optimize module to calibrate a Canopy structural dynamic model (CSDM). The calibrated model is then used to predict leaf area index (lai) based ...
7
votes
2answers
139 views
Find the closest enemy in a 2D grid with wrapping allowed
I'd like feedback on my solution to the outlined programming challenge. Is numpy a good candidate module for this? What might be a more efficient or Pythonic solution?
Closest Enemy II
Have ...
10
votes
2answers
1k views
Generating large testing datasets
I have made a small Python script that will generate some test sets for my project.
The script generates 2 datasets with the same dimensions n*m. One contains ...
-1
votes
0answers
38 views
Machine learning python MNIST dataset [closed]
I'm a noob to machine learning and i've been struggling with this for a few days now and I can't understand why my neural net is having trouble classifying the mnist dataset. I checked my math and ...
1
vote
1answer
85 views
Vectorize pairwise edit distance computation [closed]
How can I vectorize this function? It takes an array of array of tuples as input and computes the distance between elements using Levenshtein's method. I found some simpler examples but they weren't ...
7
votes
0answers
133 views
Multithreaded HD Image Processing + Logistic reg. Classifier + Visualization
[I'm awaiting suggestions for improvement/optimization/more speed/general feedback ...]
This code takes a label and a folder path of subfolders as input that have certain labels ex: trees, cats with ...
4
votes
1answer
43 views
Move values to back of an np.array()
I'm trying to create the most efficient (not nicest/prettiest) way of moving particular values within an np.array() to the back of said array.
I currently have two different solutions:
...
1
vote
1answer
36 views
Optimization fo code snippet including multiple np.multipy statements
I working on optimizing some code for speed in a python module. I have pinned down the bottleneck and is a code snippet which calculates three np.ndarrays. Namely ...
7
votes
0answers
73 views
Calculation of independence test statistic
This code (~30lines) detects independence between variables in a dataset, by using a bootstrap of a statistic. This is fully-broadcasted, but it's still long.
Reading it, or making it run, do you ...
4
votes
2answers
76 views
First program in Python for data analysis
I'm just starting my adventure with python and I wanted to share my first project with you and ask for feedback and advice. This is a script for my friend to automate all calculations and database ...
3
votes
1answer
82 views
improving speed of this numpy-based diffraction calculator
I'm going to simulate diffraction patterns of a normal incident gaussian profile beam from a 2D array of point scatterers with a distribution in heights.
The 2D array of scatterer positions ...
2
votes
0answers
44 views
Generate Black and White confidence map masks for joints, same as OpenPose/Convolutional Pose Machines
Attached below is my code for generating the confidence maps for the joint locations, it is in the same vein as the maps generated for the paper Convolutional Pose Machines and OpenPose. I am ...
1
vote
1answer
56 views
2
votes
1answer
60 views
I need to process a list of already-tokenized sentences into skipgram samples. How do I do this efficiently?
I have a customized function to accomplish the business requirement I mentioned, but this one takes a very long time to run. I was wondering if there was any way to shorten that time?
...
1
vote
0answers
21 views
DataSet Scaler with pandas
This is a Python program that takes data from Quandl Databases and formats it for my Neural Network to Train.
The code works but I'm not so confident in my code styling conventions. If you would like ...
3
votes
1answer
54 views
N-Body Gravitational Simulation of Point-Masses in Python
I made an n-body gravitational simulation in python. The algorithm does produce an approximate solution, which is shown at the bottom of the post. Additional methods to produce animations (among other ...
8
votes
3answers
622 views
Modifying Titration Data analysis results
This is my first script that I've written. As a result, I'm sure there are extra lines that are unneeded, or maybe better more concise ways of doing things than I have done here. I have tried to add ...
6
votes
2answers
145 views
A Neural Network
I programmed a Neural Network in python. Feedback every kind is appreciated.
I tried to use some vectorization but it turned out to become quite a mess. Because you can't append to numpy arrays I ...
5
votes
0answers
137 views
How can I simplify the Python code dealing with lot of images and multiplications?
With some basic knowledge of Python and referring a lot of sources, I have written the code below. But it takes half an hour for execution. How can I reduce the time? I read about vectorization but ...
5
votes
1answer
138 views
process numerical input arguments of mixed ints, floats, and “array-like” things of same length>1
I'm trying to process numerical input arguments for a function. Users can mix ints, floats, and "array-like" things of ints and float, as long as they are all length=1 or the same length>1.
Now I ...
8
votes
3answers
695 views
Creating an affinity-matrix between protein and RNA sequences
I wrote an algorithm that analyzes protein-RNA interactions and I found that the following function is the bottleneck that causes performance issues:
...
4
votes
1answer
28 views
Save points cloud in PLOT3D format
I have the following function to save points cloud in PLOT3D format:
...
5
votes
1answer
77 views
Remove words from an exclude list in each row of a pandas.Series
I am trying to remove all occurrences of the words I collect in the list exclude from every text note. This is my approach.
...
8
votes
1answer
446 views
Optimize Performance of Region Checking in List Comprehension
I am modeling a linear process at a number of equally spaced time steps. I have a large list (~70k elements) which corresponds to a location at each time step, ...
4
votes
0answers
42 views
Importer for binary datafile of PI88 Nanoindenter
As an exercise, I want to rewrite a C++ program to import measurement files (and later create excelsheets, reports ...). The measurement files split in 2 files, a binary file, and a xml-file. Because ...
5
votes
2answers
89 views
Back to Basics: Tic Tac Toe - follow-up
Follow-up from: Back to Basics - Tic Tac Toe
Again, any optimizations and critique is welcome! I'm particularly interested if it involves numpy, ...
3
votes
1answer
399 views
Minimax algorithm for tic tac toe in Python
I am using minimax algorithm (for now without alpha beta pruning) for AI in tic tac toe game in Python and Numpy. It's working, but very slow, so I would like to optimize it.
A few rules for current ...
3
votes
1answer
70 views
Back to Basics - Tic Tac Toe
I've seen a few TTT related posts recently, and thought I might learn something or be reminded of certain techniques from attempting my own rendition. Here is that attempt! Hopefully any new coders ...
5
votes
1answer
121 views
Implementing 3Blue1Brown's description of Fourier transform in Python+numpy
I have implemented the 3Blue1Brown's description of Fourier transform in Python+numpy for irregular and unsorted data, as described here.
...
1
vote
0answers
67 views
A python script to plot a joint probability mass function table [closed]
Consider this example
Suppose that 3 balls are randomly selected from an urn containing 3
red, 4 white, and 5 blue balls. If we let X and Y denote,
respectively, the number of red and white ...
1
vote
1answer
54 views
Remove outliers from N dimensional data
I have created a function that will remove outliers from a series of data. Generally the data n dimensional. Loosely, an outlier is considered an outlier if it +/- deviates by 1.5 standard_deviation's ...
3
votes
1answer
90 views
Optical dispersion calculation from spectrograms with Python
First, I'd like to provide a little explanation on what my code is supposed to do.
It is part of a middle-sized project. I restructured the code to work on its own, and also added little comments to ...
2
votes
1answer
47 views
K_nearest_neighbors from scratch [closed]
I wanted to create a script that will perform the k_nearest_neighbors algorithm on the well-known iris dataset. This was mainly for me to better understand the algorithm and process. I think it works, ...
5
votes
1answer
81 views
State space search for sliding tile puzzle
I am working on state space search (8 Puzzle) in Python and when I run my program with python3 -m profile, I find out that most of time program performs a few ...
2
votes
1answer
93 views
Particle simulator using Python - Why is the NumPy version slower than pure Python?
This is an interesting example from G.Lanaro's book, Python High Performance. The program is a simple simulator which describes movement of particles based on their positions and angular velocities (<...
5
votes
1answer
511 views
Beginning of a GUI Python solution to Andrew Ng's ML week 3 excercises
Coursera has a course for beginning Machine Learning and the code is written in Octave. This is the beginning of a solution to the week 3 exercises but written in python. Instead of a terminal app I'...
1
vote
0answers
49 views
condensed nearest centroid classifier in numpy
This is my attempt to write a numpy-optimized version of a nearest centroid classifier to classify some images from the MNIST data set of handwritten digits. I am ...
4
votes
2answers
323 views
PyTorch Vectorized Implementation for Thresholding and Computing Jaccard Index
I have been trying to optimize a code snippet which finds the optimal threshold value in a n_patch * 256 * 256 probability map to get the highest Jaccard index ...
8
votes
2answers
244 views
Schelling's model of Segregation Python implementation with Geopandas (Follow-up)
This is the repost of the following question as suggested by @HoboProber .
Again, if you don't know what is Schelling's model of segregation, you can read it here.
The Schelling model of ...
2
votes
1answer
344 views
Simple Genetic Algorithm in Python
For past few months I was trying to understand genetic algorithms (GA) and most of the materials availble in the web was not always easy for me. Then I came across this article written by Ahmed Gad ...
1
vote
2answers
64 views
Is there a way to make reshaping arrays shorter and cleaner?
I'm trying to reshape my input arrays in a way that's described below to be able to fit a curve on the data points, plot it, etc.
It works fine, but I'm afraid it's not the most efficient way of ...
1
vote
2answers
132 views
Is it worth to compromise on speed to follow PEP 8 guidelines? [closed]
I have this long line of code:
enc = encoder.predict(np.array([data[stock][4*i:4*(i+30)] for i in range(lens[stock]+days-30)]))
The problem is, the number of ...
4
votes
3answers
203 views
Fast way to calculate source response using Green's function
I am a newbie in the scientific computing in python. The function I am trying to calculate is the response of the wave equation for a given source term (For reference, See: Equation 11.67 in https://...
4
votes
1answer
141 views
Cython functions for generating NumPy date ranges
I have rewritten my python code in cython in order to speed up it quite a bit. However after checking the code in jupyter it seems that part of it is still compiled as python code, therefore its not ...
2
votes
0answers
50 views
Python - How to efficiently bin multiple dependent variables to a common independent variable?
Setup: I have ~30 parameters (dependent variables) measured simultaneously along a common time axis with ~1Hz resolution (independent variable). I need to calculate bin averages for all parameters, ...
6
votes
1answer
101 views
Schelling's model of Segregation Python implementation with Geopandas
If you don't know what is Schelling's model of segregation, you can read it here.
The Schelling model of segregation is an agent-based model that illustrates how individual tendencies regarding ...
0
votes
2answers
77 views
Read coordinates from many files and calculate polygon areas
My goal with this snippet is to create an array of coordinates which in turn is a tuple of 68 elements, area and modified area array for all 10k elements and assign it to the ...
2
votes
1answer
112 views
Game of life using NumPy
I'm trying to improve my Game of life program for school in Python, to be able to run it quicker. So if you have some ideas, I will be glad to hear them.
My current code:
...
8
votes
1answer
247 views
Bilinear image interpolation
I have written a bilinear interpolant, which is working moderately well except that is painfuly slow. How can rewrite the code to make it faster? Using opencv directly isn't a valid answer.
...
