Questions tagged [curl]

cURL is a library and command-line tool for transferring data using several protocols such as HTTP, FTP and Telnet.

Filter by
Sorted by
Tagged with
11
votes
3answers
139 views

Dynamic library to intercept oddsock hostname lookups

Just for the fun of it, I decided I would try to create sort of an intermediate DNS system for the oddsock SOCKS proxy. With this, the domain name extension .unet is statically resolved when requested....
5
votes
1answer
161 views

Reverse-engineering with Filepicker API

I have this script to pull data out of the Filepicker API internal. It's mostly reverse-engineering and the code seems to be ugly to me. How can this be improved? ...
8
votes
1answer
254 views

Optimize web-scraping of Moscow grocery website

This code works fine, but I believe it has optimization problems. Please review this. Also, please keep in mind that it stops after each iteration of the loop ...
8
votes
1answer
900 views

Bash script to clone all public repos or gists for a specified user, optionally to a directory of choice

I wrote this script as a way to backup and/or download quickly a set of repos or gists from a user. I don't have any major concerns but I'm a noob at bash scripting, and I've been scouring the ...
4
votes
1answer
4k views

Wrapping Curl, an HTTP client

I have written an HTTP client wrapped the libcurl. It should be able to do HTTP get/post with string/map param, with cookies and proxy. Can somebody review the code? B.T.W., I'm not sure the way ...
2
votes
1answer
286 views

Webhook Structuring

I am building a Webhook model so users can receive data from a messaging app. I have never created such a system before, and I'd like to get some feedback on my attempt. ...
10
votes
1answer
425 views

HTTP Stream Part 2 A stream that opens an HTTP GET and then acts like a normal C++ istream

The review I asked for yesterday was for a header only library. Stream that opens an HTTP GET and then acts like a normal C++ istream This has some limitations as it downloads all the data as part of ...
14
votes
1answer
2k views

Stream that opens an HTTP GET and then acts like a normal C++ istream

Needed a quick stream to get JSON objects. ...
2
votes
1answer
99 views

Downloading the oldest available version of some data files

I am using the cURL tool in MATLAB 2013b with Ubuntu to download a whole bunch of files. The files have one of three possible versions: 1.0.0, 2.0.0, or 2.1.0. Using the HTTP, I first check the ...
2
votes
1answer
366 views

Bash script to monitor Webserver php script

Below is a script I wrote today to use CURL to monitor the length of various HTTP server outputs and output a response if this is different than 103 characters. This is my first bash script, so I had ...
2
votes
3answers
2k views

Service status checker… Is there a more efficient way?

I've been working on a website status checker.. However this array that I use has around 30 sites within it, I've noticed it's taking around 6-7 seconds to load it. I was wondering if there's any ...
5
votes
1answer
3k views

Secure CURL to & handle response from Payment Gateway

I'm using a payment gateway and am trying to implement the post and response handling with CURL so that it all happens on one page. The following is tested and works but I want to double check it's ...
1
vote
3answers
9k views

Calling restful web services efficiently

I need to use this code to fetch data from web service and show them in a site properly but after I request for the webservice I am unable to load them fast. Site is loading very slow. ...
3
votes
1answer
707 views

Optimizing PHP script fetching entire HTML pages

The following script should get links which are stored in a text file (line by line), then put them into an array and finally scan each links' source code for a certain line. If this line is found, it ...
3
votes
1answer
4k views

DownloadFile Function (using LibCurl)

Please tell me if this function is correct (I believe it to be), efficient, and clean. Function to check: ...
5
votes
2answers
8k views

Better multithreading with network IO and database queries

I'm writing a script that: fetch a list of urls from a db (about 10000 urls) download all the pages and insert them into the db parse the code if(some condition) do other inserts into the db I have ...
2
votes
1answer
664 views

Getting a remote file to local storage

I've prepared a function using cURL to get a remote file to the local storage: ...
3
votes
1answer
4k views

Tiny Curl C++ wrapper

I have written this sample code to fetch a web page in C++ using libcurl. Please review it. ...
4
votes
1answer
346 views

Dynamic IP-address logging

Inspired by Don Stewart's article on Scripting with Haskell I tried a rewrite of a shell-script I did the other day. I was really astonished how easily it worked but as a whole it is about double the ...
13
votes
2answers
7k views

Handling many networking exceptions in Ruby

What would be a prettier/faster way to do handling of multiple errors in Ruby? Here is the code I am working with: ...

1
2