Printable Version of Topic

Posted by: emeyer May 22 2007, 07:39 AM

I've been trying to get the results out of the ALA Web Design Survey, and can't. When I try to download a CSV file, I get a network error in Safari and Firefox just downloads a zero-byte 'results.php.csv' file. wget times out while trying to download the file due to it getting no response. I removed the access control to the results so I could use cURL, but when I use this:

curl 'http://aneventapart.com/webdesignsurvey/results_csv.php?sid=2&export_type=1' -m 3600 -o 'results.csv'

...I get this in response after about 75 seconds have elapsed:

curl: (52) Empty reply from server

...or, on occasion, I get this after less than 75 seconds:

<table width="70%" align="center" cellpadding="0" cellspacing="0">
<tr class="grayboxheader">
<td width="14"><img src="http://aneventapart.com/webdesignsurvey/templates/Default/images/box_left.gif" border="0" width="14"></td>
<td background="http://aneventapart.com/webdesignsurvey/templates/Default/images/box_bg.gif">Error</td>
<td width="14"><img src="http://aneventapart.com/webdesignsurvey/templates/Default/images/box_right.gif" border="0" width="14"></td>
</tr>
</table>
<table width="70%" align="center" class="bordered_table">
<tr>
<td class="error">Error in query: Incorrect key file for table '/tmp/#sql_288c_0.MYI'; try to repair it</td>
</tr>
<tr>
<td align="center">
[ <a href="http://aneventapart.com/webdesignsurvey/index.php">Main</a>
]
</td>
</tr>
</table>

I'd really, really like to get the data out so it can be analyzed. Nothing I do seems to work. Help, please!

Posted by: emeyer May 22 2007, 10:42 AM

I should also say that yes, this is a repeat of an earlier post, and I'm sorry-- I should have replied to my earlier post with the additional information. Further digging revealed that this problem has come up before:

http://bigredspark.com/pipermail/uccass-general_bigredspark.com/2006-June/000004.html

...but there was no solution that I could find.

Posted by: emeyer May 22 2007, 10:54 AM

In the main topic post, I said:

Actually, it's 'results_csv.php'. Still a zero-length file, though. I get the same result if I ask for a table, although in that case the file name is 'results_table.php'.

Just trying to provide as much information as possible in order to find a solution!

Posted by: emeyer May 22 2007, 11:27 AM

Yes, it's me again. I remembered that I'd edited special_results.class.php to change all GREATEST to COALESCE, as per a post elsewhere on these forums. I undid that change and I'm no longer getting empty responses from the server. Now I'm getting zero-length valid responses. For example, when I request the results table, instead of a network error I get an empty file. Using cURL as follows:

curl 'http://aneventapart.com/webdesignsurvey/results_csv.php?sid=2&export_type=1' -m '3600' --connect-timeout '3600' -o 'results.csv' --trace-ascii '-'

...gets me:

== Info: About to connect() to aneventapart.com port 80
== Info: Trying 64.207.128.84... == Info: connected
== Info: Connected to aneventapart.com (64.207.128.84) port 80
=> Send header, 216 bytes (0xd8)
0000: GET /webdesignsurvey/results_csv.php?sid=2&export_type=1 HTTP/1.
0040: 1
0043: User-Agent: curl/7.13.1 (powerpc-apple-darwin8.0) libcurl/7.13.1
0083: OpenSSL/0.9.7l zlib/1.2.3
009f: Host: aneventapart.com
00b7: Pragma: no-cache
00c9: Accept: */*
00d6:
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- 0:01:17 --:--:-- 0
<= Recv header, 17 bytes (0x11)
0000: HTTP/1.1 200 OK
<= Recv header, 37 bytes (0x25)
0000: Date: Tue, 22 May 2007 16:18:32 GMT
<= Recv header, 32 bytes (0x20)
0000: Server: Apache/2.0.52 (CentOS)
<= Recv header, 12 bytes (0xc)
0000: Vary: Host
<= Recv header, 25 bytes (0x19)
0000: X-Powered-By: PHP/4.3.9
<= Recv header, 64 bytes (0x40)
0000: Set-Cookie: PHPSESSID=0d34a5250a17dbba92365663911c65e2; path=/
<= Recv header, 40 bytes (0x28)
0000: Expires: Thu, 19 Nov 1981 08:52:00 GMT
<= Recv header, 79 bytes (0x4f)
0000: Cache-Control: no-store, no-cache, must-revalidate, post-check=0
0040: , pre-check=0
<= Recv header, 18 bytes (0x12)
0000: Pragma: no-cache
<= Recv header, 54 bytes (0x36)
0000: Content-Disposition: attachment; filename=Export.csv
<= Recv header, 19 bytes (0x13)
0000: Content-Length: 0
<= Recv header, 19 bytes (0x13)
0000: Connection: close
<= Recv header, 44 bytes (0x2c)
0000: Content-Type: text/csv; charset=ISO-8859-1
0 0 0 0 0 0 0 0 --:--:-- 0:01:17 --:--:-- 0
== Info: Closing connection #0

...where the time (1:17 above) can vary from 1:10 to 1:20.

Posted by: emeyer May 24 2007, 02:26 PM

Well, we finally got the data out.

Of course, to do so, we had to do a MySQL dump and then import the dumped data onto a local machine. Then we had to edit GREATEST to COALESCE. Finally, after running the whole thing through a step-tracer, we discovered that we had to up the PHP memory limit to 512MB, because even with COALESCE the special_classes lines in question looped enough to make PHP5 run completely out of memory at its default configuration. (Under PHP4, even setting the limit to 512MB was not enough; PHP still died with the results described earlier in this thread, and in about the same amount of time.)

I don't know that there's anything you can do about that for future releases, but we thought you ought to know. Hopefully you'll see this.

Posted by: JHolmes763 May 24 2007, 08:21 PM

I think it builts up the template in memory before sending it to the browser. I'll have to find a way to fix that and have it send the pages in pieces. Thank you for the update.