#ceph IRC Log

Index

IRC Log for 2012-10-07

Timestamps are in GMT/BST.

[0:10] <grant> Um...
[0:10] <grant> pgmap v63165: 4416 pgs: 4416 active+clean; 15 EB data, 35210 MB used, 30270 GB / 31596 GB avail
[0:10] <grant> 15 EB?
[0:15] * lxo (~aoliva@lxo.user.oftc.net) has joined #ceph
[0:16] * gminks_ (~ginaminks@108-210-41-138.lightspeed.austtx.sbcglobal.net) Quit (Quit: gminks_)
[0:27] * SvenDowideit (~SvenDowid@203-206-171-38.perm.iinet.net.au) has joined #ceph
[0:29] * nwl (~levine@atticus.yoyo.org) Quit (Ping timeout: 480 seconds)
[0:39] * tren (~Adium@2001:470:b:2e8:757a:3f39:6506:5e17) has joined #ceph
[0:46] * miroslavk (~miroslavk@c-98-248-210-170.hsd1.ca.comcast.net) has joined #ceph
[1:26] * nwl (~levine@atticus.yoyo.org) has joined #ceph
[2:09] * grant (~grant@60-240-78-43.static.tpgi.com.au) Quit (Read error: Connection reset by peer)
[2:10] * BManojlovic (~steki@212.200.240.160) Quit (Quit: Ja odoh a vi sta 'ocete...)
[2:49] * miroslavk (~miroslavk@c-98-248-210-170.hsd1.ca.comcast.net) Quit (Quit: Leaving.)
[3:11] * Leseb (~Leseb@5ED01FAC.cm-7-1a.dynamic.ziggo.nl) Quit (Quit: Leseb)
[4:57] * deepsa (~deepsa@117.203.0.50) has joined #ceph
[5:13] * Cube1 (~Adium@cpe-76-95-223-199.socal.res.rr.com) has joined #ceph
[7:07] * scuttlemonkey (~scuttlemo@c-69-244-181-5.hsd1.mi.comcast.net) Quit (Quit: This computer has gone to sleep)
[7:19] * tren (~Adium@2001:470:b:2e8:757a:3f39:6506:5e17) Quit (Quit: Leaving.)
[7:25] * tren (~Adium@2001:470:b:2e8:589d:d61b:eeb6:2e88) has joined #ceph
[7:59] * gaveen (~gaveen@112.134.113.19) has joined #ceph
[8:04] * Leseb (~Leseb@5ED01FAC.cm-7-1a.dynamic.ziggo.nl) has joined #ceph
[8:04] * Leseb (~Leseb@5ED01FAC.cm-7-1a.dynamic.ziggo.nl) Quit ()
[8:53] * tren (~Adium@2001:470:b:2e8:589d:d61b:eeb6:2e88) Quit (Quit: Leaving.)
[9:05] * loicd (~loic@magenta.dachary.org) has joined #ceph
[9:49] * tziOm (~bjornar@ti0099a340-dhcp0358.bb.online.no) has joined #ceph
[10:21] * loicd (~loic@magenta.dachary.org) Quit (Quit: Leaving.)
[10:49] * stan_theman (~stan_them@173.208.221.221) Quit (Remote host closed the connection)
[10:50] * stan_theman (~stan_them@173.208.221.221) has joined #ceph
[10:51] * loicd (~loic@jem75-2-82-233-234-24.fbx.proxad.net) has joined #ceph
[10:57] <tziOm> I was wondering, if I on one host have say 20 disks, and I want to use btrfs on them but no raid (but at the same time not loose entire host when one disk goes dead) what do I do? 20 osd instances, or other way? How do you guys solve this?
[11:10] <NaioN> tziOm: 20 osds is an option
[11:10] <NaioN> i'm using that one
[11:10] <NaioN> we have osd nodes with 24 disks per node. The nodes run an osd instance per disk
[11:19] * _are_ (~quassel@2a01:238:4325:ca02::42:4242) Quit (Remote host closed the connection)
[11:23] <tziOm> Is that the preferred option?
[11:23] <tziOm> Because I mean.. what we want is afterall storage, and running raid on nodes does perhaps not make much sence
[11:23] <NaioN> it has advantages and disadvantages
[11:23] <tziOm> raid60 could be an option, but IOPS suffers alot
[11:24] <NaioN> yes but if one or two disks fail you can swap them online
[11:24] <tziOm> yeah.. but the io, as said..
[11:24] <NaioN> with no raid between you lose the osd and depending on the fs you have to reboot
[11:24] <tziOm> raid 10 is just halfing my storage
[11:25] <NaioN> you can make multiple raid5 say per 5 disks
[11:25] <tziOm> yes..
[11:25] <NaioN> you also have the advantage of multi-core
[11:25] <tziOm> ?
[11:25] <NaioN> I wouldn't advice the multithreaded patch for mdraid
[11:25] <NaioN> it's one thread per raid
[11:25] <tziOm> yeah..
[11:26] <ajm> benchmark raid60 if you use it
[11:26] <tziOm> ajm - raid60 operation tells its slow
[11:26] <ajm> way slower than raid50 in my tests, i suspected an issue with linux mdraid
[11:27] <ajm> nah, meant vs raid50 specifically on linux mdraid
[11:27] <NaioN> but with sse the mdraid should be fast enough for most cases
[11:28] <tziOm> what are the cons of just having osd handle it (that is 20 osd's/host)
[11:28] <ajm> more cpu/memory used
[11:28] <NaioN> indeed
[11:28] <tziOm> any numbers heree?
[11:29] <ajm> you want something like 1 core per osd
[11:30] <NaioN> we have a dual quad-core for 24 disks/osds
[11:31] <ajm> someone here was using some of those crazy amd processors with like 12 cores
[11:31] <ajm> 24 cores/server or something
[11:32] <NaioN> well normally the disks are the bottleneck
[11:32] <tziOm> I would think..
[11:32] <tziOm> atleast with slow sata
[11:33] <NaioN> indeed :)
[11:35] * _are_ (~quassel@2a01:238:4325:ca00:f065:c93c:f967:9285) has joined #ceph
[11:37] <tziOm> hmm..
[11:37] <tziOm> http://www.wmarow.com/strcalc/strcalc.html
[11:38] <NaioN> you can't compare that with ceph :)
[11:39] <tziOm> No, but for individual drives and arrays.. thats what everything afterall is made of.
[11:56] * _are_ (~quassel@2a01:238:4325:ca00:f065:c93c:f967:9285) Quit (Remote host closed the connection)
[11:58] * loicd (~loic@jem75-2-82-233-234-24.fbx.proxad.net) Quit (Quit: Leaving.)
[12:00] * _are_ (~quassel@2a01:238:4325:ca00:f065:c93c:f967:9285) has joined #ceph
[12:01] <tziOm> Ok, for other question..
[12:01] <tziOm> Would you do raid50 or raid5 + multiple osd?
[12:04] * _are_ (~quassel@2a01:238:4325:ca00:f065:c93c:f967:9285) Quit (Remote host closed the connection)
[12:05] * _are_ (~quassel@h1417489.stratoserver.net) has joined #ceph
[12:07] <NaioN> i would do raid5 + multiple osds per node
[12:08] <NaioN> with raid 50 you mean raid 5 on all disks
[12:08] <NaioN> well doning raid 5 on 20 disks isn't recommended
[12:08] <NaioN> you should at least use raid 6
[12:14] <tziOm> I mean x raid5 sets striped
[12:17] <Fruit> with mdadm, consider increasing the stripe cache size for performance
[12:27] * Leseb (~Leseb@5ED01FAC.cm-7-1a.dynamic.ziggo.nl) has joined #ceph
[12:45] * Leseb (~Leseb@5ED01FAC.cm-7-1a.dynamic.ziggo.nl) Quit (Quit: Leseb)
[12:54] * Ryan_Lane (~Adium@c-67-160-217-184.hsd1.ca.comcast.net) Quit (Quit: Leaving.)
[13:03] * Cube1 (~Adium@cpe-76-95-223-199.socal.res.rr.com) Quit (Quit: Leaving.)
[13:25] * Leseb (~Leseb@5ED01FAC.cm-7-1a.dynamic.ziggo.nl) has joined #ceph
[13:30] * jks (~jks@3e6b7571.rev.stofanet.dk) has joined #ceph
[13:57] * SvenDowideit (~SvenDowid@203-206-171-38.perm.iinet.net.au) Quit (Ping timeout: 480 seconds)
[14:22] * jluis (~JL@89.181.155.206) has joined #ceph
[14:24] * tziOm (~bjornar@ti0099a340-dhcp0358.bb.online.no) Quit (Remote host closed the connection)
[14:27] * joao (~JL@89.181.146.210) Quit (Ping timeout: 480 seconds)
[14:28] * scuttlemonkey (~scuttlemo@c-69-244-181-5.hsd1.mi.comcast.net) has joined #ceph
[15:09] * jluis is now known as joao
[15:28] * gaveen (~gaveen@112.134.113.19) Quit (Ping timeout: 480 seconds)
[15:29] * BManojlovic (~steki@212.200.240.160) has joined #ceph
[15:32] * loicd (~loic@magenta.dachary.org) has joined #ceph
[15:37] * gaveen (~gaveen@112.134.113.212) has joined #ceph
[15:53] * gaveen (~gaveen@112.134.113.212) Quit (Ping timeout: 480 seconds)
[16:03] * BManojlovic (~steki@212.200.240.160) Quit (Ping timeout: 480 seconds)
[16:16] * gaveen (~gaveen@112.134.112.83) has joined #ceph
[16:23] * loicd (~loic@magenta.dachary.org) Quit (Quit: Leaving.)
[16:23] * loicd (~loic@magenta.dachary.org) has joined #ceph
[16:48] * tziOm (~bjornar@ti0099a340-dhcp0358.bb.online.no) has joined #ceph
[17:39] * danieagle (~Daniel@186.214.77.66) has joined #ceph
[17:42] * loicd (~loic@magenta.dachary.org) Quit (Quit: Leaving.)
[17:44] * loicd (~loic@magenta.dachary.org) has joined #ceph
[18:10] * dty (~derek@pool-71-178-175-208.washdc.fios.verizon.net) has joined #ceph
[18:14] * gminks_ (~ginaminks@108-210-41-138.lightspeed.austtx.sbcglobal.net) has joined #ceph
[18:17] * gminks_ (~ginaminks@108-210-41-138.lightspeed.austtx.sbcglobal.net) Quit ()
[18:32] * loicd (~loic@magenta.dachary.org) Quit (Quit: Leaving.)
[18:35] * dty (~derek@pool-71-178-175-208.washdc.fios.verizon.net) Quit (Quit: dty)
[18:55] * loicd (~loic@82.233.234.24) has joined #ceph
[18:59] * gaveen (~gaveen@112.134.112.83) Quit (Remote host closed the connection)
[19:02] * danieagle (~Daniel@186.214.77.66) Quit (Quit: Inte+ :-) e Muito Obrigado Por Tudo!!! ^^)
[19:06] * tren (~Adium@216-19-187-18.dyn.novuscom.net) has joined #ceph
[19:11] * loicd (~loic@82.233.234.24) Quit (Quit: Leaving.)
[19:16] * tren (~Adium@216-19-187-18.dyn.novuscom.net) Quit (Quit: Leaving.)
[19:23] * deepsa (~deepsa@117.203.0.50) Quit (Ping timeout: 480 seconds)
[19:24] * deepsa (~deepsa@117.203.12.236) has joined #ceph
[19:29] * loicd (~loic@90.84.146.253) has joined #ceph
[19:29] * Leseb (~Leseb@5ED01FAC.cm-7-1a.dynamic.ziggo.nl) Quit (Read error: Connection reset by peer)
[19:29] * tren (~Adium@2001:470:b:2e8:a830:42ab:6dad:e206) has joined #ceph
[19:29] * Leseb (~Leseb@5ED01FAC.cm-7-1a.dynamic.ziggo.nl) has joined #ceph
[19:32] * gaveen (~gaveen@112.134.112.83) has joined #ceph
[20:02] * Ryan_Lane (~Adium@c-67-160-217-184.hsd1.ca.comcast.net) has joined #ceph
[20:04] * The_Bishop (~bishop@2001:470:50b6:0:35fc:e9aa:3704:5f72) Quit (Quit: Wer zum Teufel ist dieser Peer? Wenn ich den erwische dann werde ich ihm mal die Verbindung resetten!)
[20:05] * BManojlovic (~steki@212.200.240.160) has joined #ceph
[20:12] * nhm (~nhm@174-20-35-45.mpls.qwest.net) has joined #ceph
[20:14] * loicd (~loic@90.84.146.253) Quit (Quit: Leaving.)
[20:39] * Leseb_ (~Leseb@5ED01FAC.cm-7-1a.dynamic.ziggo.nl) has joined #ceph
[20:39] * Leseb (~Leseb@5ED01FAC.cm-7-1a.dynamic.ziggo.nl) Quit (Read error: Connection reset by peer)
[20:39] * Leseb_ is now known as Leseb
[20:51] * scuttlemonkey (~scuttlemo@c-69-244-181-5.hsd1.mi.comcast.net) Quit (Quit: This computer has gone to sleep)
[20:59] * loicd (~loic@82.235.173.177) has joined #ceph
[21:16] * Ryan_Lane (~Adium@c-67-160-217-184.hsd1.ca.comcast.net) Quit (Quit: Leaving.)
[21:46] * steki-BLAH (~steki@212.200.241.23) has joined #ceph
[21:51] * gminks_ (~ginaminks@65.104.233.242.ptr.us.xo.net) has joined #ceph
[21:53] * BManojlovic (~steki@212.200.240.160) Quit (Ping timeout: 480 seconds)
[22:14] * miroslavk (~miroslavk@173-228-38-131.dsl.dynamic.sonic.net) has joined #ceph
[22:17] * gminks_ (~ginaminks@65.104.233.242.ptr.us.xo.net) Quit (Quit: gminks_)
[22:29] * SvenDowideit (~SvenDowid@203-206-171-38.perm.iinet.net.au) has joined #ceph
[22:34] * miroslavk (~miroslavk@173-228-38-131.dsl.dynamic.sonic.net) Quit (Quit: Leaving.)
[22:47] * dty (~derek@pool-71-178-175-208.washdc.fios.verizon.net) has joined #ceph
[22:51] * MarkN (~nathan@142.208.70.115.static.exetel.com.au) has joined #ceph
[22:52] * MarkN (~nathan@142.208.70.115.static.exetel.com.au) has left #ceph
[22:57] * danieagle (~Daniel@186.214.77.66) has joined #ceph
[23:03] * loicd (~loic@82.235.173.177) Quit (Quit: Leaving.)
[23:04] * loicd (~loic@magenta.dachary.org) has joined #ceph
[23:10] * gaveen (~gaveen@112.134.112.83) Quit (Remote host closed the connection)
[23:29] * BManojlovic (~steki@212.200.241.38) has joined #ceph
[23:32] * Ryan_Lane (~Adium@c-67-160-217-184.hsd1.ca.comcast.net) has joined #ceph
[23:37] * steki-BLAH (~steki@212.200.241.23) Quit (Ping timeout: 480 seconds)
[23:43] * scuttlemonkey (~scuttlemo@c-69-244-181-5.hsd1.mi.comcast.net) has joined #ceph
[23:51] * danieagle (~Daniel@186.214.77.66) Quit (Quit: Inte+ :-) e Muito Obrigado Por Tudo!!! ^^)

These logs were automatically created by CephLogBot on irc.oftc.net using the Java IRC LogBot.