#ceph IRC Log

Index

IRC Log for 2012-12-09

Timestamps are in GMT/BST.

[0:00] * danieagle (~Daniel@177.99.135.56) has joined #ceph
[0:00] * guigouz (~guigouz@177.33.216.27) Quit (Quit: Computer has gone to sleep.)
[0:17] * loicd (~loic@magenta.dachary.org) Quit (Quit: Leaving.)
[0:17] * BillK (~billk@124-148-122-172.dyn.iinet.net.au) Quit (Ping timeout: 480 seconds)
[0:29] * deepsa (~deepsa@122.172.167.125) Quit (Ping timeout: 480 seconds)
[0:29] * miroslav (~miroslav@173-228-38-131.dsl.dynamic.sonic.net) has joined #ceph
[0:36] * BillK (~billk@58-7-118-238.dyn.iinet.net.au) has joined #ceph
[0:40] * miroslav (~miroslav@173-228-38-131.dsl.dynamic.sonic.net) Quit (Quit: Leaving.)
[0:47] <mythzib> nhm: with the kernel 3.6.9 and ceph 0.55 speed with cephfs are good... But not with RBD during both write and read
[0:48] <mythzib> strange behavior...
[0:54] * gaveen (~gaveen@112.134.113.227) Quit (Ping timeout: 480 seconds)
[0:57] <phantomcircuit> what sort of performance consideration should be given to a mon?
[1:00] <phantomcircuit> also if im not using ceph fs do i even need an mds?
[1:02] * nwat (~Adium@c-50-131-197-174.hsd1.ca.comcast.net) has joined #ceph
[1:19] * BManojlovic (~steki@242-174-222-85.adsl.verat.net) Quit (Ping timeout: 480 seconds)
[1:23] * mythzib (52e7d4bf@ircip2.mibbit.com) Quit (Quit: http://www.mibbit.com ajax IRC Client)
[1:37] * LeaChim (~LeaChim@b0fafb7d.bb.sky.com) Quit (Remote host closed the connection)
[1:38] <joao> phantomcircuit, the mds is only required for cephfs
[1:45] * jlogan1 (~Thunderbi@2600:c00:3010:1:14a3:ca45:3136:669a) Quit (Ping timeout: 480 seconds)
[1:51] * nwat (~Adium@c-50-131-197-174.hsd1.ca.comcast.net) Quit (Quit: Leaving.)
[2:16] * danieagle (~Daniel@177.99.135.56) Quit (Quit: Inte+ :-) e Muito Obrigado Por Tudo!!! ^^)
[2:37] * noob2 (~noob2@ext.cscinfo.com) has joined #ceph
[2:38] <noob2> are there any ceph stable packages for ubuntu 12.10 hidden out there?
[3:07] * nwat (~Adium@c-50-131-197-174.hsd1.ca.comcast.net) has joined #ceph
[3:13] * tziOm (~bjornar@ti0099a340-dhcp0628.bb.online.no) Quit (Remote host closed the connection)
[4:05] * KindOne (KindOne@h183.63.186.173.dynamic.ip.windstream.net) Quit (Remote host closed the connection)
[4:05] * KindOne (KindOne@h183.63.186.173.dynamic.ip.windstream.net) has joined #ceph
[4:25] * maxiz (~pfliu@111.192.247.53) has joined #ceph
[5:08] * stp__ (~stp@dslb-084-056-032-117.pools.arcor-ip.net) has joined #ceph
[5:15] <slang> noob2: not to my knowledge
[5:15] * stp (~stp@dslb-084-056-063-242.pools.arcor-ip.net) Quit (Ping timeout: 480 seconds)
[5:15] <slang> noob2: should happen soon - there's a feature to track in case you want to get notified: http://tracker.newdream.net/issues/3533
[5:17] * lxo (~aoliva@lxo.user.oftc.net) Quit (Ping timeout: 480 seconds)
[6:14] * deepsa (~deepsa@122.172.4.154) has joined #ceph
[6:17] * BillK (~billk@58-7-118-238.dyn.iinet.net.au) Quit (Ping timeout: 480 seconds)
[6:26] * BillK (~billk@124.169.79.36) has joined #ceph
[6:47] * maxiz (~pfliu@111.192.247.53) Quit (Ping timeout: 480 seconds)
[7:16] * jtangwk (~Adium@2001:770:10:500:f840:e792:e137:7a31) Quit (Ping timeout: 480 seconds)
[7:22] * gaveen (~gaveen@112.134.112.217) has joined #ceph
[7:39] * nwat (~Adium@c-50-131-197-174.hsd1.ca.comcast.net) Quit (Quit: Leaving.)
[8:10] * nwat (~Adium@c-50-131-197-174.hsd1.ca.comcast.net) has joined #ceph
[8:19] * lxo (~aoliva@lxo.user.oftc.net) has joined #ceph
[8:21] * nwat (~Adium@c-50-131-197-174.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[8:32] * Cube (~Cube@cpe-76-95-223-199.socal.res.rr.com) has joined #ceph
[9:05] * loicd (~loic@magenta.dachary.org) has joined #ceph
[9:16] * hijacker (~hijacker@213.91.163.5) Quit (Ping timeout: 480 seconds)
[9:18] * Cube (~Cube@cpe-76-95-223-199.socal.res.rr.com) Quit (Quit: Leaving.)
[9:19] * hijacker (~hijacker@213.91.163.5) has joined #ceph
[9:30] * lxo (~aoliva@lxo.user.oftc.net) Quit (Ping timeout: 480 seconds)
[9:31] * lxo (~aoliva@lxo.user.oftc.net) has joined #ceph
[9:56] * Cube (~Cube@cpe-76-95-223-199.socal.res.rr.com) has joined #ceph
[9:56] * Cube (~Cube@cpe-76-95-223-199.socal.res.rr.com) Quit ()
[10:00] * maxiz (~pfliu@221.223.236.20) has joined #ceph
[10:32] * calebamiles (~caleb@c-98-197-128-251.hsd1.tx.comcast.net) Quit (Quit: Leaving.)
[10:32] * calebamiles (~caleb@c-98-197-128-251.hsd1.tx.comcast.net) has joined #ceph
[10:33] * calebamiles (~caleb@c-98-197-128-251.hsd1.tx.comcast.net) has left #ceph
[10:52] * BManojlovic (~steki@242-174-222-85.adsl.verat.net) has joined #ceph
[11:20] * deepsa (~deepsa@122.172.4.154) Quit (Ping timeout: 480 seconds)
[11:59] * maxiz (~pfliu@221.223.236.20) Quit (Ping timeout: 480 seconds)
[12:06] * Steki (~steki@bojanka.net) has joined #ceph
[12:10] * BManojlovic (~steki@242-174-222-85.adsl.verat.net) Quit (Ping timeout: 480 seconds)
[12:31] * LeaChim (~LeaChim@b0fafb7d.bb.sky.com) has joined #ceph
[12:34] * yoshi (~yoshi@KD027091032046.ppp-bb.dion.ne.jp) has joined #ceph
[12:34] * yoshi (~yoshi@KD027091032046.ppp-bb.dion.ne.jp) Quit (Remote host closed the connection)
[12:40] * BManojlovic (~steki@242-174-222-85.adsl.verat.net) has joined #ceph
[12:44] * Steki (~steki@bojanka.net) Quit (Ping timeout: 480 seconds)
[12:45] * Steki (~steki@242-174-222-85.adsl.verat.net) has joined #ceph
[12:49] * BManojlovic (~steki@242-174-222-85.adsl.verat.net) Quit (Ping timeout: 480 seconds)
[12:55] * loicd (~loic@magenta.dachary.org) Quit (Quit: Leaving.)
[12:55] * loicd (~loic@magenta.dachary.org) has joined #ceph
[13:06] * maxiz (~pfliu@111.199.185.95) has joined #ceph
[13:24] * Ownage (~Ownage@c-98-230-196-23.hsd1.nm.comcast.net) has joined #ceph
[13:24] <Ownage> Hi. I'm running through the quick install, trying to get a feel for ceph. I'm using CentOS 6.3 . When I modprobe rbd I get module not found.
[13:34] * verwilst (~verwilst@dD5769628.access.telenet.be) has joined #ceph
[13:47] * maxiz (~pfliu@111.199.185.95) Quit (Ping timeout: 480 seconds)
[14:11] * lxo (~aoliva@lxo.user.oftc.net) Quit (Remote host closed the connection)
[14:12] * Ownage (~Ownage@c-98-230-196-23.hsd1.nm.comcast.net) Quit (Quit: Leaving)
[14:26] * lxo (~aoliva@lxo.user.oftc.net) has joined #ceph
[14:29] * ebo^ (~ebo@233.195.116.85.in-addr.arpa.manitu.net) has joined #ceph
[14:36] * danieagle (~Daniel@186.214.58.112) has joined #ceph
[14:51] * loicd (~loic@magenta.dachary.org) Quit (Quit: Leaving.)
[14:52] * loicd (~loic@magenta.dachary.org) has joined #ceph
[14:59] * nolan (~nolan@2001:470:1:41:20c:29ff:fe9a:60be) Quit (Quit: ZNC - http://znc.sourceforge.net)
[14:59] * nolan (~nolan@2001:470:1:41:20c:29ff:fe9a:60be) has joined #ceph
[15:14] <ebo^> hi everyone. i think about building a small ceph cluster for our hpc. we have around 400 cores and i'd like to run with 6 osds (2x 1gb ethernet). I care about high parallel bandwidth and graceful scaling under load. is this feasible?
[15:21] * loicd (~loic@magenta.dachary.org) Quit (Quit: Leaving.)
[15:21] * loicd (~loic@magenta.dachary.org) has joined #ceph
[15:43] * danieagle (~Daniel@186.214.58.112) Quit (Quit: Inte+ :-) e Muito Obrigado Por Tudo!!! ^^)
[15:47] * gaveen (~gaveen@112.134.112.217) Quit (Ping timeout: 480 seconds)
[15:57] * gaveen (~gaveen@112.134.113.212) has joined #ceph
[16:05] * tziOm (~bjornar@ti0099a340-dhcp0628.bb.online.no) has joined #ceph
[16:17] <nhm> ebo^: The big thing to know about ceph right now is that you write data to both the journal and to the data disk per OSD. For HPC applications if you are trying to get the maximum large block sequential write performance possible, you need to keep this in mind. I think the best way to go is to use high performance SSDs, maybe 1 per every 3-4 spinning disks for the journals.
[16:18] <nhm> ebo^: oh wait, 1gb ethernet? that's going to impose a pretty big limitation right there...
[16:26] * deepsa (~deepsa@101.62.100.44) has joined #ceph
[16:40] * plut0 (~cory@pool-96-236-43-69.albyny.fios.verizon.net) has joined #ceph
[16:41] * deepsa_ (~deepsa@122.172.15.180) has joined #ceph
[16:42] * deepsa (~deepsa@101.62.100.44) Quit (Ping timeout: 480 seconds)
[16:42] * deepsa_ is now known as deepsa
[16:53] <ebo^> I'm aware of the bandwidth limitations. i want to know if i can use the available bandwidth even if i slightly overload the cluster
[16:54] <ebo^> how much disk space does the journal take und how sensitive is it to data loss (aka do i need a raid for the ssds)?
[16:56] <ebo^> 2x gbe for both front end and cluster network
[16:58] * nwat (~Adium@c-50-131-197-174.hsd1.ca.comcast.net) has joined #ceph
[16:58] <ebo^> we currently use a expensive SAN as storage backend but it does not cope well with parallel load. total read/write space decreases steeply under load
[17:16] * verwilst (~verwilst@dD5769628.access.telenet.be) Quit (Quit: Ex-Chat)
[17:22] <Psi-jack> Hmm, okay. So, I've almost got my 3-server SAN infrastructure setup. 1 SSD each with 3 SATA3 HDD's in each. Now, regarding XFS logdev journalling, does anyone have any good recommendations for what size logdev to use for the drives?
[17:28] <Psi-jack> Planning to have the XFS logdev to SSD, as well as the OSD journal Ceph journals to the SSD. ;)
[17:32] <Psi-jack> Already got my agcount idealized pretty decently. Also curious as to how CephFS would handle multiple mixed size drives. I'm considering balancing out all my HDD's.. NAS1 has 3x320 GB, NAS2 has 4x500 GB, and NAS3 currently has only the SSD, but I'm buying 3x1 TB. But, considering spreading the 3x320 between all three servers, 3 of the 500's accross, and then the new 1 TB's, leaving only 1 500 GB drive to figure out what to do with. ;)
[18:39] * loicd (~loic@magenta.dachary.org) Quit (Quit: Leaving.)
[18:40] * loicd (~loic@magenta.dachary.org) has joined #ceph
[18:57] * PerlStalker (~PerlStalk@72.166.192.70) has joined #ceph
[19:25] * nwat (~Adium@c-50-131-197-174.hsd1.ca.comcast.net) Quit (Quit: Leaving.)
[19:26] * loicd (~loic@magenta.dachary.org) Quit (Quit: Leaving.)
[19:26] * loicd (~loic@magenta.dachary.org) has joined #ceph
[19:27] <noob2> slang: thanks for the link!
[19:35] * denken (~denken@dione.pixelchaos.net) Quit (Quit: dist-upgrade)
[19:41] * denken (~denken@dione.pixelchaos.net) has joined #ceph
[19:48] * stp__ (~stp@dslb-084-056-032-117.pools.arcor-ip.net) Quit (Ping timeout: 480 seconds)
[19:52] * nwat (~Adium@soenat3.cse.ucsc.edu) has joined #ceph
[20:27] * noob2 (~noob2@ext.cscinfo.com) Quit (Ping timeout: 480 seconds)
[20:50] * CristianDM (~CristianD@host100.190-139-215.telecom.net.ar) has joined #ceph
[20:50] <CristianDM> Hi
[20:52] <CristianDM> I canĀ“t start mds after 0.55 upgrade
[20:52] <CristianDM> monclient(hunting): none of our auth protocols are supported by the server
[21:01] * CristianDM (~CristianD@host100.190-139-215.telecom.net.ar) Quit ()
[21:04] * gaveen (~gaveen@112.134.113.212) Quit (Quit: Leaving)
[21:12] <ebo^> hmm 0.55 mkcephfs core dumps on ceph-osd when doing the quick start
[21:13] * tryggvil (~tryggvil@17-80-126-149.ftth.simafelagid.is) Quit (Quit: tryggvil)
[21:17] <ebo^> 0.48 crashes too
[21:17] <ebo^> nice
[21:26] * gaveen (~gaveen@112.134.113.212) has joined #ceph
[21:33] * mib_5dd5vq (52e7d4bf@ircip2.mibbit.com) has joined #ceph
[21:33] * wer_gone (~wer@wer.youfarted.net) Quit (Ping timeout: 480 seconds)
[21:36] * wer_gone (~wer@wer.youfarted.net) has joined #ceph
[21:40] * gaveen (~gaveen@112.134.113.212) Quit (Quit: Leaving)
[22:11] * loicd (~loic@magenta.dachary.org) Quit (Quit: Leaving.)
[22:11] * loicd (~loic@magenta.dachary.org) has joined #ceph
[22:13] * lerrie2 (~Larry@remote.compukos.nl) has joined #ceph
[22:15] * nwat (~Adium@soenat3.cse.ucsc.edu) Quit (Quit: Leaving.)
[22:18] * Ryan_Lane (~Adium@c-67-160-217-184.hsd1.ca.comcast.net) Quit (Quit: Leaving.)
[22:30] * danieagle (~Daniel@186.214.58.112) has joined #ceph
[22:36] * nwat (~Adium@c-50-131-197-174.hsd1.ca.comcast.net) has joined #ceph
[22:37] * nwat (~Adium@c-50-131-197-174.hsd1.ca.comcast.net) Quit ()
[22:45] * joao (~JL@89-181-150-134.net.novis.pt) Quit (Ping timeout: 480 seconds)
[22:50] * nwat (~Adium@c-50-131-197-174.hsd1.ca.comcast.net) has joined #ceph
[22:58] * nwat (~Adium@c-50-131-197-174.hsd1.ca.comcast.net) Quit (Quit: Leaving.)
[23:09] * nwat (~Adium@c-50-131-197-174.hsd1.ca.comcast.net) has joined #ceph
[23:20] * nwat (~Adium@c-50-131-197-174.hsd1.ca.comcast.net) Quit (Quit: Leaving.)
[23:22] * Leseb (~Leseb@5ED01FAC.cm-7-1a.dynamic.ziggo.nl) has joined #ceph
[23:26] * danieagle (~Daniel@186.214.58.112) Quit (Quit: Inte+ :-) e Muito Obrigado Por Tudo!!! ^^)
[23:30] * Psi-jack (~psi-jack@psi-jack.user.oftc.net) Quit (Read error: No route to host)
[23:31] * Psi-jack (~psi-jack@psi-jack.user.oftc.net) has joined #ceph
[23:53] * nwat (~Adium@c-50-131-197-174.hsd1.ca.comcast.net) has joined #ceph
[23:59] * tziOm (~bjornar@ti0099a340-dhcp0628.bb.online.no) Quit (Remote host closed the connection)

These logs were automatically created by CephLogBot on irc.oftc.net using the Java IRC LogBot.