Questions tagged [data-importer]

The import and export of data is the automated or semi-automated input and output of data sets between different software applications. It involves "translating" from the format used in one application into that used by another, where such translation is accomplished automatically via machine processes, such as transcoding, data transformation, and others.

Filter by
Sorted by
Tagged with
0 votes
1 answer
40 views

Multiple CSV Imports with Pandas

I have a class that is importing a CSV file into a Pandas DataFrame. However, this CSV has a multiline header that changes length seemingly at random. Sometimes it is 27 lines, sometimes 31, sometimes ...
user avatar
2 votes
2 answers
729 views

Get all data from an external and paginated Swagger API using Java / Feign / Spring

I have written the following method that allows me to import from another API all the items stored there using Feign. The only issue is that the external API provides a size limit of 2000 and ...
user avatar
  • 789
0 votes
2 answers
2k views

Open text file and read data to an arrayfire array using Qt and C++

I'm currently writing a C++ project with a Qt GUI and would like to read numerical data from user-selected text files through QtFileDialog::getOpenFileName. There ...
user avatar
1 vote
0 answers
64 views

Optimizing Text Data Import From MatLab

I want to import some data to a 2-D vector. The data type is double like 5.8774718e-39, and the size is ...
user avatar
  • 11
2 votes
2 answers
364 views

Modify and import as numpy.ndarray a txt file in python

To import the data contained into the file my_file.txt that have the form: ...
user avatar
  • 199
1 vote
1 answer
404 views

How to refactor this importer to handle validation errors?

This is my importer to database from excel file. I would like to handle situations when any error raise. To not breaks whole import when one errors occurs. For example when there is duplicated record ...
user avatar
1 vote
1 answer
162 views

What are best practices of creating database importer in Rails?

I have sample database in GES files and I wrote importer in Ruby. Sample file: WAR_APO.GES: https://gist.github.com/regedarek/...
user avatar