Search string in a list

Question

data = ['HTTP/1.1 200 OK', 'CACHE-CONTROL: max-age=1810', 'DATE: Wed, 14 May 2014 12:15:19 GMT', 'EXT:', 'LOCATION: http://192.168.94.57:9000/DeviceDescription.xml', 'SERVER: Windows NT/5.0, UPnP/1.0, pvConnect UPnP SDK/1.0', 'ST: uuid:7076436f-6e65-1063-8074-78542e239ff5', 'USN: uuid:7076436f-6e65-1063-8074-78542e239ff5', 'Content-Length: 0', '', '']

From the above list, I have to extract the .xml link.

My code:

for element in data:
    if 'LOCATION' in element:
        xmllink = element.split(': ').[1]

It's taking too much time. How can I make this faster?

Actually I am doing SSDP discovery for finding devices in a network. After sending the M-SEARCH command, devices send a datagram packet which I have taken in a data variable. From this I have to extract the file link of that device for processing it.

When I use indexing to extract, it was done quickly.

Answer 1

You want to test for element.startswith('LOCATION: '). You are doing 'LOCATION' in element, which is not only slower since it has to check at every position of every element, it might also lead to false matches.

Also, element and data are poor names. I suggest header and headers, respectively.

My suggestion:

LOC = 'LOCATION: '
xmllinks = [header[len(LOC):] for header in headers if header.startswith(LOC)]
if xmllinks:
    xmllink = xmllinks[0]

Answer 2

I am not sure what is causing problem. This piece of code should not take up a lot of time. But here are some of the suggestions to speed up your code:

1. Instead of list, create a set. The lookup time in set is constant.
2. But the main problem with set is uses up more memory in comparison to list. So another option is to keep a sorted list (if possible) and use the bisect module to search the list.

Now some style suggestions:

for element in data:
  if 'LOCATION' in element:
    xmllink = element.split(': ').[1]

rewrite it as

for element in data:
   if 'LOCATION' in element and ':' in element:
     xmllink = element.split(':')[1].strip()

This ensures that if a string like 'LOCATION something' is in list then it will not raise any errors.

The .strip() is a better way to remove trailing whitespaces

Answer 3

With such a small input it should be lightning fast. Anyway, shouldn't you break after finding the element? I'd write:

xmllink = next(s.split(":", 1)[1].strip() for s in data if s.startswith("LOCATION:")