-
Bad Robot
GigaBot/2.0 is
hammeringover accessing my server...Why does it need to request my robots.txt this much? Not to mention all the pages it is indexing as well. hmmmmm.
64.62.168.16 - - [12/Sep/2004:05:07:19 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [12/Sep/2004:05:07:59 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [12/Sep/2004:05:13:15 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [12/Sep/2004:05:14:19 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [12/Sep/2004:05:18:13 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [12/Sep/2004:05:26:47 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [12/Sep/2004:05:27:33 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [12/Sep/2004:05:33:28 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [12/Sep/2004:05:34:09 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [12/Sep/2004:20:07:49 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [12/Sep/2004:20:08:32 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [12/Sep/2004:20:12:50 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [12/Sep/2004:20:13:21 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [12/Sep/2004:20:23:01 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [12/Sep/2004:20:27:00 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [12/Sep/2004:20:28:21 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [12/Sep/2004:20:37:59 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [12/Sep/2004:20:38:48 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [12/Sep/2004:20:42:08 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [12/Sep/2004:20:42:57 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [12/Sep/2004:20:47:55 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [12/Sep/2004:20:53:52 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [12/Sep/2004:20:54:21 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [12/Sep/2004:21:06:31 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [12/Sep/2004:21:07:46 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [12/Sep/2004:21:16:12 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [12/Sep/2004:21:17:05 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [12/Sep/2004:21:25:22 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [12/Sep/2004:21:25:45 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [12/Sep/2004:21:29:39 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [12/Sep/2004:21:30:33 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [12/Sep/2004:21:33:19 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [12/Sep/2004:21:33:39 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [12/Sep/2004:21:38:53 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [12/Sep/2004:21:39:37 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [12/Sep/2004:22:02:40 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [12/Sep/2004:22:03:00 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [12/Sep/2004:22:06:22 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [12/Sep/2004:22:13:43 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [12/Sep/2004:22:15:04 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [12/Sep/2004:22:28:43 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [12/Sep/2004:22:42:15 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [12/Sep/2004:22:43:12 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [12/Sep/2004:22:45:37 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [12/Sep/2004:22:51:45 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [12/Sep/2004:22:55:06 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [12/Sep/2004:23:01:14 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [12/Sep/2004:23:01:19 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [12/Sep/2004:23:06:22 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [12/Sep/2004:23:07:03 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [12/Sep/2004:23:24:20 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [12/Sep/2004:23:25:43 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [12/Sep/2004:23:32:37 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [12/Sep/2004:23:33:52 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [12/Sep/2004:23:48:24 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [12/Sep/2004:23:53:32 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [12/Sep/2004:23:54:14 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:00:04:03 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:00:04:46 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:00:13:34 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:00:14:15 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:00:19:02 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:00:19:38 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:00:22:20 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:00:35:02 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:00:44:06 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:00:45:00 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:00:56:21 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:00:56:36 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:01:01:07 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:01:01:59 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:01:23:24 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:01:23:33 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:01:37:58 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:01:39:08 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:01:42:41 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:01:51:10 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:01:51:27 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:02:01:37 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:02:02:07 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:02:19:51 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:02:20:07 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:02:31:10 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:02:32:08 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:02:39:35 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:02:44:02 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:03:00:23 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:03:00:34 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:03:04:59 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:03:11:56 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:03:11:57 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:03:14:31 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:03:21:14 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:03:22:16 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:03:38:16 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:03:41:41 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:03:45:06 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:03:52:16 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:03:53:01 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:03:56:59 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:04:03:51 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:04:06:04 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:04:10:47 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:04:21:33 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:04:22:42 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:04:34:48 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:04:36:09 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:04:38:26 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:04:42:18 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:04:43:08 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:04:57:35 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:04:59:12 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:05:02:20 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:05:12:41 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:05:13:51 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:05:16:00 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:05:27:46 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:05:28:46 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:05:39:25 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:05:46:08 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:05:47:03 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:05:53:17 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:06:00:07 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:06:01:02 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:06:02:48 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:06:04:46 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:06:13:05 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:06:17:50 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:06:34:45 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:06:40:15 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:06:42:21 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:06:52:50 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:06:53:43 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:06:58:53 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:06:59:32 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:07:12:24 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:07:13:21 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:07:18:39 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:07:19:21 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:07:33:58 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:07:34:38 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:07:34:39 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:07:45:26 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:07:46:16 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:07:49:24 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:07:50:05 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:07:53:57 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:07:54:51 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:07:59:11 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:08:03:34 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:08:09:27 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:08:16:14 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:08:16:24 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:08:21:17 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:08:24:26 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:08:25:18 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:08:28:58 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:08:33:39 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:08:37:44 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:08:39:02 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:08:44:36 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:08:44:55 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:08:53:02 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:08:57:00 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:09:00:37 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:09:01:24 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:09:06:50 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:09:07:37 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:09:12:41 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:09:13:08 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:09:17:25 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:09:18:38 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:09:24:29 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:09:25:51 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:09:27:56 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:09:33:09 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:09:38:48 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:09:47:05 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:09:49:10 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:09:56:13 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:09:57:23 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:10:06:01 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:10:06:48 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:10:13:13 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:10:16:05 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:10:20:32 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:10:21:13 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:10:29:37 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:10:30:52 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:10:37:19 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:10:37:31 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:10:42:53 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:10:45:28 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:10:48:23 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:10:51:42 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:11:01:01 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:11:03:00 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:11:08:33 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:11:10:35 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:11:23:33 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:11:24:18 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:11:28:14 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:11:29:16 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:11:42:53 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:11:45:05 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:11:48:29 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:11:48:39 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:11:58:09 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:11:59:03 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:12:01:59 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:12:12:21 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:12:12:56 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:12:19:34 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:12:19:41 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:12:25:02 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:12:28:37 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:12:33:22 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:12:54:03 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:12:54:59 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:13:01:07 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:13:01:07 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:13:02:29 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:13:07:58 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:13:13:30 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:13:16:45 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:13:32:22 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:13:32:56 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:13:37:21 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:13:43:49 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:13:44:10 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:13:54:53 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:13:55:04 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:14:01:37 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:14:01:57 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:14:09:30 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:14:09:44 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:14:14:05 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:14:22:37 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:14:25:59 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:14:27:49 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:14:31:52 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:14:32:49 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:14:37:14 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:14:38:23 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:14:43:08 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:14:53:09 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:14:53:27 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:15:01:21 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:15:02:46 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:15:12:37 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:15:19:10 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:15:19:20 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:15:33:46 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:15:34:48 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:15:39:52 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:15:42:43 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:15:52:06 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:15:52:17 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:15:59:56 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:16:00:07 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:16:07:46 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:16:07:57 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:16:19:22 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:16:21:26 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:16:28:20 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:16:32:05 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:16:32:43 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:16:55:19 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:17:08:16 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:17:08:32 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:17:11:26 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:17:15:53 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:17:22:28 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:17:23:38 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:17:28:26 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:17:37:33 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:17:42:21 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:17:48:53 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:17:49:51 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:17:56:25 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:17:57:56 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:18:02:01 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:18:15:57 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:18:22:33 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:18:23:01 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:18:26:53 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:18:36:19 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:18:38:06 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:18:56:55 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:19:07:19 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:19:07:43 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:19:14:22 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:19:14:40 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:19:20:43 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:19:21:33 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:19:30:54 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:19:32:06 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:19:44:11 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:19:56:30 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:20:04:17 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:20:04:38 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:20:15:35 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:20:15:49 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:20:22:25 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:20:27:10 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:20:27:51 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:20:49:09 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:20:53:22 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:20:54:04 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:21:02:34 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:21:06:00 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:21:16:12 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:21:18:31 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:21:28:50 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:21:29:11 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:21:36:39 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:21:45:24 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:21:50:54 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:21:51:01 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:22:02:02 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:22:07:08 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:22:18:20 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:22:18:35 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:22:26:03 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:22:26:48 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:22:40:36 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:22:43:43 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:22:44:43 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:22:47:42 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:22:49:26 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:23:02:47 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:23:07:48 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:23:12:52 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:23:18:59 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:23:22:15 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:23:23:02 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:23:33:47 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [13/Sep/2004:23:44:10 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:23:45:56 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:23:52:21 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [13/Sep/2004:23:57:26 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [14/Sep/2004:00:07:56 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [14/Sep/2004:00:08:08 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [14/Sep/2004:00:11:45 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [14/Sep/2004:00:11:58 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [14/Sep/2004:00:16:57 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [14/Sep/2004:00:20:30 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [14/Sep/2004:00:32:10 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [14/Sep/2004:00:32:28 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [14/Sep/2004:00:41:55 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [14/Sep/2004:00:55:49 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [14/Sep/2004:00:56:08 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [14/Sep/2004:01:01:18 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [14/Sep/2004:01:06:14 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [14/Sep/2004:01:19:34 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [14/Sep/2004:01:19:53 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [14/Sep/2004:01:30:34 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [14/Sep/2004:01:36:23 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [14/Sep/2004:01:37:43 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [14/Sep/2004:02:01:23 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [14/Sep/2004:02:01:37 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [14/Sep/2004:02:04:24 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [14/Sep/2004:02:07:38 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [14/Sep/2004:02:10:20 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [14/Sep/2004:02:29:49 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [14/Sep/2004:02:32:12 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [14/Sep/2004:02:38:16 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [14/Sep/2004:02:55:16 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [14/Sep/2004:02:55:44 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [14/Sep/2004:02:57:55 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [14/Sep/2004:03:18:47 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [14/Sep/2004:04:25:02 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [14/Sep/2004:04:30:31 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [14/Sep/2004:04:45:57 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [14/Sep/2004:04:52:49 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [14/Sep/2004:05:08:58 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [14/Sep/2004:05:14:24 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [14/Sep/2004:05:16:02 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.16 - - [14/Sep/2004:05:34:41 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [14/Sep/2004:05:35:25 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [14/Sep/2004:05:53:13 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [14/Sep/2004:06:13:02 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [14/Sep/2004:06:35:18 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [14/Sep/2004:06:52:45 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [14/Sep/2004:07:14:54 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [14/Sep/2004:10:12:43 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0" 64.62.168.18 - - [14/Sep/2004:12:11:29 +0100] "GET /robots.txt HTTP/1.0" 200 85 "-" "Gigabot/2.0"
... as far as I can tell /robots.txt is valid, and it's a static text file so it's not changing... bah.
-
More Apple Security Crapness
Cleartext passwords written to disk
http://seclists.org/lists/bugtraq/2004/Jul/0166.html
For those that this is a bit to techy for, when your OS X machine starts to use up all it's RAM it starts writing lesser used bits of information for programs running in the background onto disk. You can prevent this from happening by allocating memory to not be written to disk, but oh no, it appears several parts of OS X allow for unencrypted passwords to be written onto the disk. Nice :-(
The fact that Apple haven't responded to an issue is further equating them to being Microsoft #2.
leave a comment
-
Site Update
New CMS + Now XHTML-1.0 STRICT
I've updated my site to use a newer CMS [as used on PostEverything and various other sites] and to use XHTML-1.0 STRICT and CSS. I think that some of the CMS generated content might break the HTML validation, so I'm going to work on that now.
I'm a bit late in the day bringing this site to use these standards, but it's a first step and I'll be doing the same to PostEverything over the coming months. The implementation for older browsers isn't as clean as I'd like, so I'll probably tweak that too.
Why no redesign? Well I like the design, the minimalism it, and rather than redesign it I thought I'd just add some new interfaces in future. Then people can choose what they see.
leave a comment
-
...remember that thingy we did with a green dotted chap dancing like a chava.
It won the creative award at The Revolution Awards on Friday,
so a big thankyou for your help on it from dare and me.
Cyrushttp://www.lynxpulse.co.uk
[Site appears to have been replaced with a newer version]
leave a comment
-
Windows Media Player HDWMV on Mac OS
It should work, it does work, but not quite...
I was looking at the Windows Media High Definition Content Showcase site the other day, and downloaded some of the files to check out on my PC. Very nice I thought. The 1080p files play very nicely on my 3Ghz/1Gb/Radeon 9800 (128Mb) system. I woudl have expected as much... but was that some articacting I saw? Just a little bit. Well never mind. It still looks pretty amazing!
Then my thought turned to my Mac. I've just got a new 1Ghz G4 Laptop. after an accident with my old TiBook. It's got 1.5Gb RAM and a ATI Mobility Radeon 9600 (64Mb) ... it's below equivalent spec of what's on the site for a PC but I thought I'd give it a whirl. The 720p videos did open, but didn't play at all efficiently. No surprise there.
So In turn I decided to try it on Adam at SHOWstudio's G5 tower. Dual 2Ghz with 1.5Gb RAM and ATI Radeon 9800 (128Mb) ... generally consdiered faster than most Pentium based machines. I donwloadede the .exe's [which are self extracting winzip files which Stuffit easily expands].The 720p file mostly played, with a couple of stutters where there were large changes on screen [a fade at the begining of one of the files]. With the 1080p it just didn't handle it.
Which seems a bit odd, given that the shorted pipeline [and I could be wrong here] in the PowerPC processors should be better for the kind of maths involved in video decompression. My conclusion is that Windows Media Player 9 for the Mac just isn't as well written. This might not be microsofts fault, it could simply be that it _can't_ be as well written because of the OS X environtment [again I could be wrong here] or it could be that it's intentionally not as well written for OS X.
I wonder if anyone has any more thoughts on this?
leave a comment
-
Problems reading burnt ext2 DVDs
Eric Waters suggests it might be a block size issue
I've not had anyproblems with a block size of 1024, but Eric said he checked it out and 2048 was the appropriate blocksize for DVDs, so that might be it
I found your website in a google search for info on burning DVD's in
Linux. After following your instructions, I was able to nicely burn an
unmountable ext2 DVD. The problem, I discovered (through the help of
http://www.linux.net.nz/lists/NZLUG/2003/07/1243.html), is that the DVD
is burned with a sector size of 2048k, so therefore the blocksize of the
ext2 image (created with dd and mke2fs) must be 2048, *not 1024*.So, instead of:
dd \
if=/dev/zero \ # read input for file from /dev/zero
of="ext2_file" \ # output file
bs=1024k \ # file has block size of 1024k [1 Megabyte]
count=4096 # file has 4096 blocks [4 Gigabytes]mke2fs \
-b 1024 \ # block size
-F \ # Force [I shouldn't have to use this, but I do]
ext2_file # input file... it should be this:
dd \
if=/dev/zero \ # read input for file from /dev/zero
of="ext2_file" \ # output file
bs=2048k \ # file has block size of 2048k [2 Megabytes]
count=2048 # file has 2048 blocks [4 Gigabytes]mke2fs \
-b 2048 \ # block size
-F \ # Force [I shouldn't have to use this, but I do]
ext2_file # input file?You might want to add this to the webpage so others don't burn a coaster
like myself.Eric Waters
leave a comment
-
The Royal Armouries
Information Architecture and Design
So, this has been ongoing for a couple of years, but it's finally live [well a few weeks ago].
A few bits of the design and HTML I provided for the site build seem to have been broken during implementation of the CMS, eleventeenth are taking on board all the feedback about the problems and sorting them out pretty quickly. I wish I had had more time to give feedback during the beta phase, so sort of my own fault. Now we wait for the armouries to produce the content!
Another empty wrapper.
I'm also aware that this goes against my ethics against violence and war, but I don't feel this is a celebration of war, rather than a study of it. The same contradiction exists in that I'm interested in Martial Arts, and enjoy a good explosion. I'm just against un-necessary violence were it is subjected upon innocent people. And so are the Armouries.
leave a comment
-
leave a comment
-
Norman Jay - Good Times
videoblogging from notting hill carnival
http://www.showstudio.com/projects/jay/jay_start.html
I spent the bank holiday weekend mostly working on this. SHOWstudio arranged for two photographers to go out each day of carnival to send back the experience via mobile phones. I've already developed the software to publish photographs to the web, some simple perl scripts. But for this we also wanted to use a 3G video phone.
First of we got sent some NEC e606 handsets. Whilst these were quite compact and OK to use, there is no email client in them, so getting them of required getting them to another phone and then offloading them to a computer. Done using some windows software supplied by NEC, whcih was a bit awkward. I wanted to automate the process so we got hold of some NEC e808 handsets which have an email client that can send attachments. So we could get video to the server no problem.
A few experiments at a Squarepusher gig proved that whilst the video was interesting the sound wasn't so hot when the volume was high. We also had music that we wanted to use and so it seemed like a good idea to strip out the sound from the MP4 files that we received from the phone. I thought this would be pretty trivial as I could just load the files into QuickTime and strip them - this is easy to do in QuickTime Player. Obviously that's no good on Linux though.
So I looked at what was available for Linux and, as expected, was disappointed. There are several solutions for playing video and loading codecs, but the libraries are scarecly documented [that I could find] and few utilities exist. I naively assumed that the quicktime file structure would be quite simple and therefore easy to manipulate, but some investigation has proven me wrong. Having since delved more into QuickTime's API and features I can understand why it might not be worth trying to do more than video playback.
I dove into the QuickTime Java API thinking that the solution might lie there, and initial reads made me feel quite confident that I could write a Java app to do the work. So I set about working out how to get a Mac server that I could run the app on. I ended up putting my G4 laptop into Internet Vision's rack at RedBus for a few days.
And set about writing QTDemux.java ... I've discovered a few things about QuickTime and QuickTime for Java along the way:
QuickTime is a very powerful toolset.
The document format is overly complex.
The Java API is very poorly documented.But I managed it.
And then strung together some front end interfaces using SMIL, and discovered that it was too heavy at the front end. QuickTime Player seems to suffer quite badly when you are trying to do quite trivial SMIL work. I can see this being down to the difference in model between SMIL and it's own document format. The thing is that these should essentially be the same thing, and therefore I can't understand why it's not. I think I maybe have a DOM mode of the QuickTime in my head, one that could be simplified, and would map to the DOM that exists in SMIL as well.
There have been several itterations of what I wanted to do with the videos. I wanted to get across an idea of the 'everything going off' feeling I've had when I've gone to carnival. I decided to arrange the videos in a grid and control them using SMIL. I'd alternate between still images [pulled out by the QTDemux app] and video. Maybe play 2 videos at once. They were only small [<12 seconds, 174 x 144, 2.5 fps, MP4, <100k]. And a soundtrack.
That's asking too much. It sort of works. But audio doesn't. Trying to play music along side just stuttered on my iBook. And I reckon that's probably going to be the case with most users. So I changed my approach and removed the music. But as the number of clips increased, quicktime carried on slowing down. I tried to stagger the loads, so that images loaded at different times, but eventually resigned to the fact that - as I knew already, but hoped the situation had improved - I needed to simplify it. So we've now just got the videos pulled in reverse chronological order with a random soundtrack. Simple, but I think it's still a nice mood.
Gerald Jenkins was given the NEC e808 video phone, and a Nokia 3650 for stills. He was also given a back stage pass to the Good Times stage, so that he could film Norman Jay and what was going on around him. His stills are the monotones on the site, taken as colour and then passed through Perl::Magick. Gerald was around the stage on both days of the carnival, and towards the end was starting to feel limited with the video phone towards the end, and I can understand that. Whilst downloading and playing back videos on the phone is quite impressive, the video functions aren't all that yet for recording, and the frame rate can be annoyingly low. That combined with cramped conditions and a quite ugly handset [the silver e808 looks like a compact. And I mean the kind for make up]. It's going to take some getting used to. The other stills on the site were taken with a Nokia 7650, published straight out to the site. I enjoyed the contract between the different photographers on the project. That's something you'll have to take in by looking at it.
Easy peasy once the pieces are in place.
leave a comment
-
Adventures in MobLoging
or mblging or whatever catchphrase is appropriate.
In preperation for sorting out SHOWstudio's MMS to web gateway I've tidied up the code I wrote last december to allow me to post to my site via my mobile phone. It's a pretty simple perl script which executes via a pipe when mail is received, and files any attachments and inserts the contents of the message into a DB.
I've got it set up to post to MoveableType. Probably could be set to post to other blogging tools as well. Hmmmmm.
leave a comment
leave a comment
2006.04.27 10:53 GMT
http://www.gigablast.com/spider.html
This will tell you how to block it
2006.04.27 12:46 GMT
thanks, you've reminded me I've killed my robots.txt file 'cos of the mod_rewrite rules for the site restructuring!