#ceph IRC Log

Index

IRC Log for 2011-08-12

Timestamps are in GMT/BST.

[0:00] <joshd> I also see you have both mds0 and mon0 trying to use the same port - I think they should just start using the next one up automatically, but I'm not sure
[0:03] * MK_FG (~MK_FG@188.226.51.71) has joined #ceph
[0:05] <cp> joshd: Did that (abs paths, different ports), but still no luck
[0:05] <cp> starting mon.0 rank 0 at 192.168.1.100:6790/0 mon_data /etc/ceph/ceph_osd/dev/mon0 fsid 1226255c-abe1-b43b-4df9-7e09a8171232
[0:05] <cp> accepter.bind unable to bind to 192.168.1.100:6790: Cannot assign requested address
[0:06] <cp> for "service ceph start", and same failure for "ceph -s"
[0:07] <joshd> try restarting all the ceph services
[0:07] <cp> You mean "service ceph -a start" ?
[0:08] <joshd> does "service ceph restart" work? I don't use ubuntu often
[0:09] <cp> service ceph restart
[0:09] <cp> === mon.0 ===
[0:09] <cp> === mon.0 ===
[0:09] <cp> Stopping Ceph mon0 on node2...done
[0:09] <cp> === mon.0 ===
[0:09] <cp> Starting Ceph mon0 on node2...
[0:09] <cp> ** WARNING: Ceph is still under heavy development, and is only suitable for **
[0:09] <cp> ** testing and review. Do not trust it with important data. **
[0:09] <cp> starting mon.0 rank 0 at 192.168.1.100:6790/0 mon_data /etc/ceph/ceph_osd/dev/mon0 fsid 1226255c-abe1-b43b-4df9-7e09a8171232
[0:09] <cp> accepter.bind unable to bind to 192.168.1.100:6790: Cannot assign requested address
[0:09] <cp> failed: ' /usr/bin/cmon -i 0 -c /etc/ceph/ceph.conf '
[0:09] <cp> === mds.0 ===
[0:09] <cp> === mds.0 ===
[0:09] <cp> Stopping Ceph mds0 on node2...done
[0:09] <cp> === mds.0 ===
[0:09] <cp> Starting Ceph mds0 on node2...
[0:09] <cp> ** WARNING: Ceph is still under heavy development, and is only suitable for **
[0:09] <cp> ** testing and review. Do not trust it with important data. **
[0:09] <cp> starting mds.0 at 0.0.0.0:6800/13696
[0:09] <cp> === mds.a ===
[0:09] <cp> === mds.a ===
[0:09] <cp> Stopping Ceph mds.a on node2...done
[0:09] <cp> === mds.a ===
[0:09] <cp> Starting Ceph mds.a on node2...
[0:09] <cp> ** WARNING: Ceph is still under heavy development, and is only suitable for **
[0:09] <cp> ** testing and review. Do not trust it with important data. **
[0:09] <cp> starting mds.a at 0.0.0.0:6801/13817
[0:09] <cp> === osd.0 ===
[0:09] <cp> === osd.0 ===
[0:10] <cp> Stopping Ceph osd0 on node2...done
[0:10] <cp> === osd.0 ===
[0:10] <cp> Starting Ceph osd0 on node2...
[0:10] <cp> ** WARNING: Ceph is still under heavy development, and is only suitable for **
[0:10] <cp> ** testing and review. Do not trust it with important data. **
[0:10] <cp> starting osd0 at 0.0.0.0:6802/13956 osd_data /etc/ceph/ceph_osd/dev/osd0 /etc/ceph/ceph_osd/dev/osd0/journal
[0:10] <joshd> oh, it's stopping and starting each individually. that's not as useful as I'd hoped
[0:12] <cp> Here's what the mkcephfs printed:
[0:12] <cp> mkcephfs --allhosts -c /etc/ceph/ceph.conf -k /etc/ceph/keyring.bin
[0:12] <cp> /usr/bin/monmaptool --create --clobber --add 0 192.168.1.100:6790 --print /tmp/monmap.12502
[0:12] <cp> /usr/bin/monmaptool: monmap file /tmp/monmap.12502
[0:12] <cp> /usr/bin/monmaptool: generated fsid 1226255c-abe1-b43b-4df9-7e09a8171232
[0:12] <cp> epoch 1
[0:12] <cp> fsid 1226255c-abe1-b43b-4df9-7e09a8171232
[0:12] <cp> last_changed 2011-08-11 23:04:08.668933
[0:12] <cp> created 2011-08-11 23:04:08.668933
[0:12] <cp> 0: 192.168.1.100:6790/0 mon.0
[0:12] <cp> /usr/bin/monmaptool: writing epoch 1 to /tmp/monmap.12502 (1 monitors)
[0:12] <cp> max osd in /etc/ceph/ceph.conf is 0, num osd is 1
[0:12] <cp> /usr/bin/osdmaptool: osdmap file '/tmp/osdmap.12502'
[0:12] <cp> /usr/bin/osdmaptool: writing epoch 1 to /tmp/osdmap.12502
[0:12] <cp> Building admin keyring at /etc/ceph/keyring.bin
[0:12] <cp> creating /etc/ceph/keyring.bin
[0:12] <cp> Building monitor keyring with all service keys
[0:12] <cp> creating /tmp/monkeyring.12502
[0:12] <cp> importing contents of /etc/ceph/keyring.bin into /tmp/monkeyring.12502
[0:12] <cp> creating /tmp/keyring.mds.0
[0:12] <cp> importing contents of /tmp/keyring.mds.0 into /tmp/monkeyring.12502
[0:12] <cp> creating /tmp/keyring.mds.a
[0:12] <cp> importing contents of /tmp/keyring.mds.a into /tmp/monkeyring.12502
[0:12] <cp> creating /tmp/keyring.osd.0
[0:12] <cp> importing contents of /tmp/keyring.osd.0 into /tmp/monkeyring.12502
[0:13] <cp> === mon.0 ===
[0:13] <cp> ** WARNING: Ceph is still under heavy development, and is only suitable for **
[0:13] <cp> ** testing and review. Do not trust it with important data. **
[0:13] <cp> /usr/bin/cmon: created monfs at /etc/ceph/ceph_osd/dev/mon0 for mon.0
[0:13] <cp> `/etc/ceph/keyring.bin' -> `/etc/ceph/ceph_osd/dev/mon0/admin_keyring.bin'
[0:13] <cp> === mds.0 ===
[0:13] <cp> WARNING: no keyring specified for mds0
[0:13] <cp> === mds.a ===
[0:13] <cp> WARNING: no keyring specified for mds.a
[0:13] <cp> === osd.0 ===
[0:13] <cp> ** WARNING: Ceph is still under heavy development, and is only suitable for **
[0:13] <cp> ** testing and review. Do not trust it with important data. **
[0:13] <cp> created object store /etc/ceph/ceph_osd/dev/osd0 journal /etc/ceph/ceph_osd/dev/osd0/journal for osd0 fsid 1226255c-abe1-b43b-4df9-7e09a8171232
[0:13] <cp> WARNING: no keyring specified for osd0
[0:13] <joshd> you can see which ports are being used with 'netstat -atun' - just find an unused one for mon0
[0:14] <joshd> and then start mon0 again, and it should work
[0:16] <cp> Ah... I'm just being foolish. I had the wrong IP for this box
[0:17] <cp> (this one is 101, the other window is 100)
[0:17] <joshd> that would explain it
[0:22] <cp> sweet. Mounted! Thanks Joshd!
[0:23] <cp> (now: repeat from scratch to be sure I know what actually worked) :)
[0:25] <joshd> no problem
[0:40] <bchrisman> what will cause .git_version to be reassembled/recreated?
[0:44] <jojy> is there a cmd to get pg info for a rbd device?
[0:47] <joshd> jojy: there's no command for that
[0:51] <joshd> bchrisman: 'make .git_version' in the src directory
[0:57] <joshd> jojy: right now, I think the simplest way to find out is to look at the osd logs (grep for image_name.rbd) after reading or writing to the image
[0:57] <jojy> joshd;thanks!
[1:09] * phil_ (~quassel@chello080109010223.16.14.vie.surfer.at) Quit (Remote host closed the connection)
[1:17] * Tv (~Tv|work@aon.hq.newdream.net) Quit (Ping timeout: 480 seconds)
[1:24] * aliguori (~anthony@cpe-70-123-132-139.austin.res.rr.com) Quit (Read error: Connection reset by peer)
[2:22] <cp> Quick question: I stopped and restarted ceph and now I can't access the mount point. When I try to unmount I get the following message:
[2:23] <cp> umount /mnt/osd
[2:23] <cp> umount: /mnt/osd: device is busy.
[2:23] <cp> (In some cases useful info about processes that use
[2:23] <cp> the device is found by lsof(8) or fuser(1))
[2:23] <cp> mount error 5 = Input/output error
[2:25] <joshd> does 'lsof +D /mnt/osd' show anything?
[2:27] <joshd> and if this is the ceph filesystem you've got mounted there, what does 'ceph -s' show?
[2:27] <cp> In one case it shows nothing. In the other case it hangs.
[2:27] <joshd> ceph -s hangs?
[2:28] <cp> OK. in one case it does come back and seem to work. On the other box 'lsof +D /mnt/osd' hangs
[2:28] <cp> The difference I think is that I accidentally ran the ceph start command with a different ceph.conf file in the default location.
[2:29] <cp> ceph -s works fine on both now
[2:29] <joshd> does it report all pgs being active+clean?
[2:30] <cp> 22/44 degraded
[2:30] <cp> ceph -s
[2:30] <cp> 2011-08-12 01:29:57.203457 pg v16: 264 pgs: 264 active+clean+degraded; 39 KB data, 1249 MB used, 865 GB / 912 GB avail; 22/44 degraded (50.000%)
[2:30] <cp> 2011-08-12 01:29:57.204034 mds e12: 1/1/1 up {0=up:replay}, 1 up:standby
[2:30] <cp> 2011-08-12 01:29:57.204083 osd e5: 1 osds: 1 up, 1 in
[2:30] <cp> 2011-08-12 01:29:57.204147 log 2011-08-12 01:16:50.685799 mon0 192.168.1.101:6790/0 3 : [INF] mds? 192.168.1.101:6806/21450 up:boot
[2:30] <joshd> the client probably a timed out when you restarted ceph, that's why it hung until it could reconnect
[2:30] <cp> 2011-08-12 01:29:57.204197 mon e1: 1 mons at {0=192.168.1.101:6790/0}
[2:30] <joshd> oh right, you're only running one osd
[2:30] <joshd> that's fine
[2:30] <cp> so far :)
[2:31] <joshd> with one osd, and the default replication level of 2, you'll always be degraded (since none of the pgs are replicated)
[2:31] <cp> ah, of course
[2:32] <joshd> yeah, restarting the mds will make any mountpoints hang until it comes back up I beleive
[2:33] <cp> Hmmm, though the mds is up now but I can't even "ls /mnt". Strange
[2:34] <joshd> is it 'up:active' yet?
[2:34] <joshd> I think it has to finish replay before it accepts requests again, but I'm not sure
[2:35] <joshd> gregaf could tell you more if he's around
[2:35] <joshd> I don't know the mds very well
[2:35] <cp> ah, sorry - yeah, it's still on standby
[2:36] <cp> ok
[2:46] * jojy (~jojyvargh@70-35-37-146.static.wiline.com) Quit (Quit: jojy)
[2:59] * Juul (~Juul@slim.visitor.camp.ccc.de) has joined #ceph
[3:06] * cmccabe (~cmccabe@69.170.166.146) has left #ceph
[3:11] * bchrisman (~Adium@70-35-37-146.static.wiline.com) Quit (Quit: Leaving.)
[3:16] * joshd (~joshd@aon.hq.newdream.net) Quit (Quit: Leaving.)
[3:20] * huangjun (~root@113.106.102.8) has joined #ceph
[3:37] * cp (~cp@74.85.19.35) Quit (Quit: This computer has gone to sleep)
[3:49] * yehuda_hm (~yehuda@99-48-179-68.lightspeed.irvnca.sbcglobal.net) Quit (Ping timeout: 480 seconds)
[3:55] * jojy (~jojyvargh@75-54-231-2.lightspeed.sntcca.sbcglobal.net) has joined #ceph
[3:55] * jojy (~jojyvargh@75-54-231-2.lightspeed.sntcca.sbcglobal.net) Quit ()
[3:58] * yehuda_hm (~yehuda@99-48-179-68.lightspeed.irvnca.sbcglobal.net) has joined #ceph
[4:14] * DanielFriesen (~dantman@S0106001731dfdb56.vs.shawcable.net) has joined #ceph
[4:18] * Dantman (~dantman@S0106001731dfdb56.vs.shawcable.net) Quit (Ping timeout: 480 seconds)
[4:25] * bchrisman (~Adium@c-98-207-207-62.hsd1.ca.comcast.net) has joined #ceph
[4:42] * yehuda_hm (~yehuda@99-48-179-68.lightspeed.irvnca.sbcglobal.net) Quit (resistance.oftc.net larich.oftc.net)
[4:42] * MK_FG (~MK_FG@188.226.51.71) Quit (resistance.oftc.net larich.oftc.net)
[4:42] * nolan (~nolan@phong.sigbus.net) Quit (resistance.oftc.net larich.oftc.net)
[4:42] * darkfaded (~floh@188.40.175.2) Quit (resistance.oftc.net larich.oftc.net)
[4:42] * atg (~atg@please.dont.hacktheinter.net) Quit (resistance.oftc.net larich.oftc.net)
[4:42] * gregaf (~Adium@ip-64-111-111-107.dreamhost.com) Quit (resistance.oftc.net larich.oftc.net)
[4:42] * jeffhung (~jeffhung@60-250-103-120.HINET-IP.hinet.net) Quit (resistance.oftc.net larich.oftc.net)
[4:43] * yehuda_hm (~yehuda@99-48-179-68.lightspeed.irvnca.sbcglobal.net) has joined #ceph
[4:43] * MK_FG (~MK_FG@188.226.51.71) has joined #ceph
[4:43] * nolan (~nolan@phong.sigbus.net) has joined #ceph
[4:43] * darkfaded (~floh@188.40.175.2) has joined #ceph
[4:43] * jeffhung (~jeffhung@60-250-103-120.HINET-IP.hinet.net) has joined #ceph
[4:43] * gregaf (~Adium@ip-64-111-111-107.dreamhost.com) has joined #ceph
[4:43] * atg (~atg@please.dont.hacktheinter.net) has joined #ceph
[6:47] * The_Bishop (~bishop@port-92-206-21-65.dynamic.qsc.de) Quit (Quit: Wer zum Teufel ist dieser Peer? Wenn ich den erwische dann resette ich ihm die Verbindung!)
[6:57] * hutchins (~hutchins@c-75-71-83-44.hsd1.co.comcast.net) has joined #ceph
[7:00] * hutchins (~hutchins@c-75-71-83-44.hsd1.co.comcast.net) Quit (Remote host closed the connection)
[8:19] * phil_ (~quassel@chello080109010223.16.14.vie.surfer.at) has joined #ceph
[8:47] * Juul (~Juul@slim.visitor.camp.ccc.de) Quit (Ping timeout: 480 seconds)
[9:22] * Juul (~Juul@81.162.147.21) has joined #ceph
[9:25] * pmjdebruijn (~pascal@overlord.pcode.nl) Quit (Quit: leaving)
[9:31] * Juul (~Juul@81.162.147.21) Quit (Ping timeout: 480 seconds)
[9:41] * Juul (~Juul@slim.visitor.camp.ccc.de) has joined #ceph
[10:22] * julienhuang (~julienhua@pasteur.dedibox.netavenir.com) has joined #ceph
[10:22] * Juul (~Juul@slim.visitor.camp.ccc.de) Quit (Ping timeout: 480 seconds)
[10:40] * julienhuang (~julienhua@pasteur.dedibox.netavenir.com) Quit (Quit: julienhuang)
[11:08] <royh> On Centos 6.0 I get "configure: error: no tcmalloc found (use --without-tcmalloc to disable)". anyone know the solution for this? (apart from the obvious --without-tcmalloc)?
[11:19] <damoxc> http://google-perftools.googlecode.com/svn/trunk/doc/tcmalloc.html
[11:20] <damoxc> so install google perftools
[11:45] <royh> damoxc: I've done that. it's in /usr/include/google/
[11:49] <royh> I'll just symlink it for now :)
[11:53] <damoxc> :-)
[11:57] * jim (~chatzilla@astound-69-42-16-6.ca.astound.net) Quit (Ping timeout: 480 seconds)
[11:58] <royh> seems the problem is I'm getting the i686 from a x86_64 repos
[13:48] * huangjun (~root@113.106.102.8) Quit (Quit: Lost terminal)
[14:29] * aliguori (~anthony@cpe-70-123-132-139.austin.res.rr.com) has joined #ceph
[14:35] <todin> hi, is the ceph barclamp for crowbar already available?
[14:59] * allsystemsarego (~allsystem@188.27.167.186) has joined #ceph
[15:03] * phil__ (~quassel@chello080109010223.16.14.vie.surfer.at) has joined #ceph
[15:08] * phil_ (~quassel@chello080109010223.16.14.vie.surfer.at) Quit (Ping timeout: 480 seconds)
[17:19] * Tv (~Tv|work@aon.hq.newdream.net) has joined #ceph
[17:22] * Tv (~Tv|work@aon.hq.newdream.net) Quit ()
[17:25] * Tv (~Tv|work@aon.hq.newdream.net) has joined #ceph
[17:45] * bchrisman (~Adium@c-98-207-207-62.hsd1.ca.comcast.net) Quit (Quit: Leaving.)
[17:56] * yehuda_hm (~yehuda@99-48-179-68.lightspeed.irvnca.sbcglobal.net) Quit (Ping timeout: 480 seconds)
[18:09] * badari_office (~badari@32.97.110.59) has joined #ceph
[18:09] * badari__ (~badari@32.97.110.59) Quit (Read error: Connection reset by peer)
[18:10] * badari__ (~badari@32.97.110.59) has joined #ceph
[18:10] * badari_office (~badari@32.97.110.59) Quit (Read error: Connection reset by peer)
[18:11] * badari_office (~badari@bi-01.bluebird.ibm.com) has joined #ceph
[18:11] * badari__ (~badari@32.97.110.59) Quit (Read error: Connection reset by peer)
[18:12] * badari_office (~badari@bi-01.bluebird.ibm.com) Quit (Read error: Connection reset by peer)
[18:12] * badari_office (~badari@32.97.110.59) has joined #ceph
[18:13] * badari__ (~badari@32.97.110.59) has joined #ceph
[18:13] * badari_office (~badari@32.97.110.59) Quit (Read error: Connection reset by peer)
[18:14] * badari_office (~badari@32.97.110.59) has joined #ceph
[18:14] * badari__ (~badari@32.97.110.59) Quit (Read error: Connection reset by peer)
[18:16] * badari__ (~badari@bi-01.bluebird.ibm.com) has joined #ceph
[18:16] * badari_office (~badari@32.97.110.59) Quit (Read error: Connection reset by peer)
[18:16] * badari_office (~badari@32.97.110.59) has joined #ceph
[18:17] * badari__ (~badari@bi-01.bluebird.ibm.com) Quit (Read error: Connection reset by peer)
[18:18] * darktim (~andre@ticket1.nine.ch) Quit (Remote host closed the connection)
[18:18] * badari_office (~badari@32.97.110.59) Quit (Read error: Connection reset by peer)
[18:21] * phil__ (~quassel@chello080109010223.16.14.vie.surfer.at) Quit (Remote host closed the connection)
[18:32] * bchrisman (~Adium@70-35-37-146.static.wiline.com) has joined #ceph
[18:38] * joshd (~joshd@aon.hq.newdream.net) has joined #ceph
[18:46] * greglap (~Adium@166.205.141.136) has joined #ceph
[18:53] * hutchins (~hutchins@c-75-71-83-44.hsd1.co.comcast.net) has joined #ceph
[18:53] * hutchins (~hutchins@c-75-71-83-44.hsd1.co.comcast.net) Quit ()
[19:01] * cmccabe (~cmccabe@69.170.166.146) has joined #ceph
[19:02] <joshd> todin: the barclamp isn't ready yet - there'll probably be a mailing list post when it is
[19:03] * jojy (~jojyvargh@70-35-37-146.static.wiline.com) has joined #ceph
[19:04] <jojy> josh: did u mention about a upcoming patch that has local read option
[19:05] <jojy> joshd:did u mention about a upcoming patch that has local read option
[19:06] <joshd> no, that's already implemented, but only works when there are no writes
[19:53] * cp (~cp@74.85.19.35) has joined #ceph
[20:20] * tjikkun (~tjikkun@2001:7b8:356:0:225:22ff:fed2:9f1f) has joined #ceph
[20:28] * allsystemsarego (~allsystem@188.27.167.186) Quit (Quit: Leaving)
[20:37] * Juul (~Juul@node-tp5.camp.ccc.de) has joined #ceph
[20:43] <lxo> can I put the journal in osd*/current, so that, when I take a btrfs snapshot of current, I have it all covered?
[20:43] <lxo> (I mean, would this cause any problems during recovery?)
[20:47] <sjust> Ixo: I'm not sure what that would do, actually, the Filestore does snapshots of current in order to create consistent recovery points
[20:47] <sjust> I think that putting the journal there would cause serious problems
[20:47] <lxo> what it would do is enable me to create and name my own recovery points
[20:48] <sjust> The filestore needs to be able to roll back current without changing the journal
[20:48] <lxo> anyway, I just found out it doesn't work. I create the journal, and then it is promptly thrown away when I restart the osd :-)
[20:49] <sjust> Ixo: yeah, it can't work, sorry about thta
[20:50] <lxo> so... what I want to do is take a snapshot of the cluster so I can roll back to it later, if it gets corrupted, so I don't have to start from scratch
[20:51] <lxo> without using a journal, I've had moderate luck taking snapshots of osd/current and mon/current on quiescent cluster, and then testing manual rollback
[20:51] <lxo> (I have everything replicated onto all 3 osds)
[20:52] <lxo> now, I'd like to use a journal to speed things up, but I gather taking a snapshot of both osd and osd/current is even less likely to get a consistent cut than just osd/current
[20:52] * jim (~chatzilla@astound-69-42-16-6.ca.astound.net) has joined #ceph
[20:54] <lxo> now, what would be *really* awesome would be some ceph command that would tell all mons and osds to snapshot the current state with a given globally-consistent tag name. does such a feature exist, or is it planned? (should I file a feature request?)
[20:54] <sjust> Ixo: doing clean shutdowns on all of the osds and then doing snapshots might work
[20:54] <sjust> Ixo: there is a pool snapshot system
[20:54] <sjust> Ixo: but it's likely to be corrupted if the reset of the cluster gets corrupted
[20:55] <sjust> Ixo: taking a snapshot of the file store directory should be adequate as long as the journal is empty
[20:56] <lxo> s/reset/rest/ ?
[20:56] <sjust> Ixo: ah, yes
[20:57] <lxo> thanks for the advice. I'll going to play a bit with it
[21:19] * Juul (~Juul@node-tp5.camp.ccc.de) Quit (Ping timeout: 480 seconds)
[21:47] * sagewk (~sage@ip-64-111-111-107.dreamhost.com) Quit (Read error: Operation timed out)
[21:50] * Tv (~Tv|work@aon.hq.newdream.net) Quit (Ping timeout: 480 seconds)
[21:51] * sjust (~sam@ip-64-111-111-107.dreamhost.com) Quit (Ping timeout: 480 seconds)
[21:51] * joshd (~joshd@aon.hq.newdream.net) Quit (Ping timeout: 480 seconds)
[21:52] * yehudasa (~yehudasa@ip-64-111-111-107.dreamhost.com) Quit (Ping timeout: 480 seconds)
[21:53] * gregaf (~Adium@ip-64-111-111-107.dreamhost.com) Quit (Ping timeout: 480 seconds)
[21:55] * greglap (~Adium@166.205.141.136) Quit (Quit: Leaving.)
[22:01] * tjikkun (~tjikkun@2001:7b8:356:0:225:22ff:fed2:9f1f) Quit (Quit: Ex-Chat)
[22:04] * tjikkun (~tjikkun@2001:7b8:356:0:225:22ff:fed2:9f1f) has joined #ceph
[22:04] * tjikkun_ (~tjikkun@2001:7b8:356:0:225:22ff:fed2:9f1f) has joined #ceph
[22:04] * tjikkun_ (~tjikkun@2001:7b8:356:0:225:22ff:fed2:9f1f) Quit ()
[22:20] <cmccabe> hmm, metropolis seems to be down/disconnected?
[22:21] * tjikkun (~tjikkun@2001:7b8:356:0:225:22ff:fed2:9f1f) Quit (Quit: Ex-Chat)
[22:38] * lxo (~aoliva@659AADKHT.tor-irc.dnsbl.oftc.net) Quit (Remote host closed the connection)
[22:38] * lxo (~aoliva@82VAAC30I.tor-irc.dnsbl.oftc.net) has joined #ceph
[22:45] * greglap (~Adium@166.205.141.136) has joined #ceph
[22:50] * tjikkun (~tjikkun@195-240-187-63.ip.telfort.nl) has joined #ceph
[22:54] <greglap> cmccabe: I can't seem to reach our dev machines in Aon, eithef
[23:23] * yehudasa (~yehudasa@adsl-99-139-62-62.dsl.irvnca.sbcglobal.net) has joined #ceph
[23:27] * joshd (~joshd@99.139.62.62) has joined #ceph
[23:28] <cmccabe> greglap: I still have the problem too
[23:29] <greglap> Aon networking is down; I didn't know that metropolis went through there but it might for networking purposes
[23:32] * gregaf (~Adium@99.139.62.62) has joined #ceph
[23:32] * joshd (~joshd@99.139.62.62) Quit (Read error: Connection reset by peer)
[23:33] * joshd (~joshd@99.139.62.62) has joined #ceph
[23:37] * sjust (~sam@adsl-99-139-62-62.dsl.irvnca.sbcglobal.net) has joined #ceph
[23:48] * yehudasa (~yehudasa@adsl-99-139-62-62.dsl.irvnca.sbcglobal.net) Quit (Read error: Connection reset by peer)
[23:48] * joshd (~joshd@99.139.62.62) Quit (Remote host closed the connection)
[23:48] * gregaf1 (~Adium@adsl-99-139-62-62.dsl.irvnca.sbcglobal.net) has joined #ceph
[23:49] * sjust (~sam@adsl-99-139-62-62.dsl.irvnca.sbcglobal.net) Quit (Read error: Connection reset by peer)
[23:50] * gregaf (~Adium@99.139.62.62) Quit (Read error: Connection reset by peer)
[23:50] * sjust (~sam@adsl-99-139-62-62.dsl.irvnca.sbcglobal.net) has joined #ceph
[23:50] * yehudasa (~yehudasa@adsl-99-139-62-62.dsl.irvnca.sbcglobal.net) has joined #ceph
[23:50] * joshd (~joshd@adsl-99-139-62-62.dsl.irvnca.sbcglobal.net) has joined #ceph

These logs were automatically created by CephLogBot on irc.oftc.net using the Java IRC LogBot.