Questions tagged [curl]

cURL is a library and command-line tool for transferring data using several protocols such as HTTP, FTP and Telnet.

Filter by
Sorted by
Tagged with
5
votes
2answers
8k views

Better multithreading with network IO and database queries

I'm writing a script that: fetch a list of urls from a db (about 10000 urls) download all the pages and insert them into the db parse the code if(some condition) do other inserts into the db I have ...
0
votes
1answer
25 views

Refactoring with many duplicates using Bash [closed]

I have a curl based working bash script, but I have many duplicates on the "CURL" body. How do I improve it efficiently to eliminate duplications? ...
1
vote
0answers
34 views

PHP API Query using CURL and return JSON

Fairly new to writing PHP. I want some PHP code to query an API with a post request, set specific headers and message body, and echo out the JSON response. This is the code I have come up with, which ...
4
votes
2answers
66 views

Upload a directory, in parallel, to an artifact repository

This code uploads an entire directory and allows for its reparenting on a remote server (an artifact repository). Three concerns: Copying the files locally takes a lot of space. Ideally, I could use ...
2
votes
1answer
287 views

Retrying Curl X amounts of Time until Successful Return (Script/Functions)

I'm under no illusion that this is at all the best way or even a good way of doing this. It's simply a working solution. Tips, opinions, suggestions, insults, death threats, let's hear it. ...
3
votes
1answer
1k views

Laravel voting system

I have written a voting class in Laravel. It uses the voting sites API to check if the user has voted today. A user is only allowed to vote once every day. All votes reset at midnight (i.e. 12:00 AM ...
4
votes
0answers
73 views

Perl PasteBin scraper

I'd like to optimize my code and get a better of understanding of how I can perform the task I am doing better. I've only used Perl threads about 3 or 4 times now. The purpose of my script / code ...
13
votes
2answers
5k views

Sending an SMS message in C

Recently I've been fiddling with the idea of sending a text message using C. Looking at a few options, I thought that using libcurl to send an SMTP email using TLS for some security would be the best ...
3
votes
1answer
906 views

Optimize cURL requests to Google API

I have a table in MySQL with approx. 20 million rows and the following columns: id | word_eng | word_indic I have to translate the English word (the value in ...
1
vote
0answers
43 views

Getting a filename from Mediafire

In short, how do I improve my code? I have a couple of files on Mediafire.com, link to shared folder for the purpose of this question. I would like to get a list of download-links and filenames so I ...
0
votes
1answer
91 views

Displaying an order status form

Below is code i used to call Api and display the "Status" results in web page. my senior told me that code is completely mess and need to improve so that it should be easy to understand for others. ...
0
votes
1answer
179 views

Wrapper class for calling external API [closed]

I have a PHP cronjob script. I need to send requests and get responses from some external API. So, there is code for the API class. In this class, I connect to the API and call public methods of ...
7
votes
3answers
2k views

Getting the current IP from the command line

I made a tiny little bash script, that prints the current IP Address to the command line. I checked the script with ShellCheck (0.4.6-1) on a local debian install and I get the following message: ...
2
votes
2answers
360 views

cURL grabber, gets info from imdb & allmusic

I've put together a class that grabs data from imdb.com or allmusic.com, then inserts the data into a database, copy's the poster, also updates the data if ...
1
vote
0answers
77 views

Fetch value from website using cURL

I want to make a http request, get the website content and check one specific element. Currently I'm doing it with lcurl (got explanations from a tutorial). Here is an excerpt of my code: ...
3
votes
0answers
119 views

Curl-based REST Client Library (round 3)

This code review request relates to this code review which covers the basic single REST call use case in this this REST client library. This code review covers the classes and unit tests for the ...
2
votes
0answers
89 views

Curl-based REST client library (round 2)

This is a second iteration on an earlier review - cURL based REST client library I have done some refactoring to split out the REST HTTP response into it's own class from what was in the previous ...
3
votes
2answers
656 views

cURL based REST client library

I have recently refactored a REST client library and was hoping to get review for both the class itself and the unit tests that cover it. This code is developed against PHP 7.1, but tested against ...
1
vote
1answer
410 views

Multithreaded cURL wrapper

The following is a class for curl wrapper. This class will be called like: ...
2
votes
0answers
820 views

Convert a curl command into Ruby

I had a curl command which I converted using this. This is the Ruby script: ...
3
votes
0answers
506 views

Ruby script to to check the status of a rabbitmq queue and send alert

We are using a message broker called rabbitmq. The code checks the status of number of messages in q queue and sent messages. This is achieved by a curl request to a given API.The script has a sleep ...
4
votes
2answers
3k views

C++ Wrapper for cURL: Multithreading and serializing asynchronous ops

I did this library to help me from one of my projects and decided to publish it on GitHub hoping people might find it useful, convenient and easy to use in their projects too. It's a header-only ...
3
votes
1answer
2k views

Downloading images using CURL

I've written this class that downloads an images, the URLs for which are read from a local .txt file. I'm keen to make sure my code is safe and efficient. ...
4
votes
1answer
812 views

Pool of curl handles

I am trying to write a simple reusable pool of curl handles. I found this wonderful implementation of the blocking queue. The pool itself looks like this: ...
1
vote
2answers
459 views

Sending email using libcurl - follow-up 2

This question is a continuation of: Sending email using libcurl - follow-up Does this code have any problems? Can I improve it? ...
2
votes
1answer
999 views

Combining json responses of recursive web service calls with PHP and curl

I'm implementing the Hotel Price List API from Skyscanner. This requires a first call to the service to implement a session followed by 1 or more calls to the service to get the actual results. I've ...
3
votes
2answers
6k views

Sending email using libcurl

I developed a function to send email based on this. Does this code have problems? Also, I'm not sure if this code is thread-safe because of the global payloadText ...
3
votes
1answer
956 views

Sending email using libcurl - follow-up

This question is continuation of: Sending email using libcurl I developed a class to send email. Does this code have any problems? Is it thread-safe? ...
0
votes
2answers
431 views

Movie data scraping

I enter in the IMDb link and YouTube trailer link in the command line to a movie and the first main program loads all the info about the movie. The second main program uses an IMDb link to the movie ...
3
votes
1answer
89 views

Parses XML to return the bus times at specified bus stop

The code uses the XML-based OC Transpo data feed to create a list of the bus name, where it's headed, and the times. Keep in mind that I am a beginner at python so any advice at all is appreciated. <...
4
votes
1answer
1k views

Pulling data from API, Allowed memory exhausted

I'm working on a project where I pull data (JSON) from an API. I would like to manipulate this data and store this as useful information in my DB (MySQL). My code is working if I would like to make, ...
1
vote
1answer
49 views

Extracting site visit information from a REST API call, including addresses from a MySQL database

I'm building a web app that pulls data from a ticketing system via REST API. I'm currently able to pull all of the data I need just fine but the loading process is really slow. I'd love any feedback ...
1
vote
1answer
531 views

Using cURL to retrieve remote image

I am using the following code to retrieve the URL of a random image in a remote folder that I own. As a newbie and although this is working I would like to know if this is done properly, if it could ...
9
votes
2answers
3k views

Pinging a URL with libcurl

I've asked a question about pinging a URL before, but I wanted something that was a bit shorter and still just as efficient. libcurl seemed to be the perfect answer. Here is my method: ...
1
vote
2answers
164 views

Crawling SPOJ through cURL and C++

I am trying to write industry standard code. https://www.quora.com/How-do-I-follow-a-user-on-Spoj-for-solving-problems-Refer-Details Someone gave me this A2A. And I wrote this code for it ...
4
votes
2answers
554 views

calloc, malloc, free and realloc wrappers to store the size being allocated

I'm currently building a node.js addon for libcurl. Right now I'm trying to correctly use v8::Isolate::GetCurrent()->AdjustAmountOfExternalAllocatedMemory to ...
2
votes
1answer
99 views

Downloading the oldest available version of some data files

I am using the cURL tool in MATLAB 2013b with Ubuntu to download a whole bunch of files. The files have one of three possible versions: 1.0.0, 2.0.0, or 2.1.0. Using the HTTP, I first check the ...
3
votes
1answer
1k views

cURL GET requests receiving XML data

First of all, I would like to know if there is any difference (execution-time) in C between: GET request made by using cURL GET request make by using sockets (BSD sockets) Second, I've done a C ...
1
vote
0answers
21 views

Send Google Cloud Messages

I wrote code which is doing query and insert inside while loop. ...
13
votes
2answers
7k views

Handling many networking exceptions in Ruby

What would be a prettier/faster way to do handling of multiple errors in Ruby? Here is the code I am working with: ...
5
votes
0answers
684 views

Reusing curl easy handles in C

In a C project I want to reuse curl easy handles. The flow of program is like: Client --> C Application --> Call URL1, do something, Call URL2, do something, Call URL3... In short, for each client ...
1
vote
0answers
517 views

URL image validation

I'm trying to write a method to validate an image from a URL. The method will accept an array of image URL. The image should be validated by its type, size and dimensions. Right now, I'm able to ...
1
vote
1answer
94 views

Checking whether a site is up or down

I have this PHP curl function to check if a site is online or not: ...
1
vote
1answer
134 views

DMZ passthru script

I have a server that cannot be connected to from the internet, but I need to get some info to it. I have another server that can, so I have a simple passthru script that I want to see if you all think ...
2
votes
1answer
596 views

Getting a remote file to local storage

I've prepared a function using cURL to get a remote file to the local storage: ...
2
votes
2answers
4k views

Upload image from Remote Server using URL

This PHP class is to allow user to enter a URL of a remote image file and have it download the image to local server. It will be used in a Markdown editor just like Stack Overflow / Stack Exchange ...
4
votes
1answer
342 views

Dynamic IP-address logging

Inspired by Don Stewart's article on Scripting with Haskell I tried a rewrite of a shell-script I did the other day. I was really astonished how easily it worked but as a whole it is about double the ...
3
votes
1answer
4k views

DownloadFile Function (using LibCurl)

Please tell me if this function is correct (I believe it to be), efficient, and clean. Function to check: ...
3
votes
1answer
4k views

Tiny Curl C++ wrapper

I have written this sample code to fetch a web page in C++ using libcurl. Please review it. ...