#ceph IRC Log

Index

IRC Log for 2013-09-20

Timestamps are in GMT/BST.

[0:03] * dpippenger (~riven@tenant.pas.idealab.com) Quit (Remote host closed the connection)
[0:03] * ishkabob (~c7a82cc0@webuser.thegrebs.com) has joined #ceph
[0:03] * gucki (~smuxi@HSI-KBW-109-192-187-143.hsi6.kabel-badenwuerttemberg.de) Quit (Ping timeout: 480 seconds)
[0:03] <ishkabob> hey guys, can i set "journal aio = true" on the live system with injectargs?
[0:05] * roald (~roaldvanl@87.209.150.214) has joined #ceph
[0:05] <gregaf> looks like "no"; it'd be pretty weird to make it switch up journaling modes in the middle of transactions!
[0:06] * ScOut3R (~scout3r@4E5C2305.dsl.pool.telekom.hu) Quit (Remote host closed the connection)
[0:06] * rendar (~s@host228-182-dynamic.20-87-r.retail.telecomitalia.it) Quit ()
[0:08] <dmick> mattt: reopened 5804
[0:08] <dmick> feel free to add commentary if you think it'll help illuminate
[0:09] * bandrus (~Adium@cpe-76-95-217-129.socal.res.rr.com) has joined #ceph
[0:09] * roald (~roaldvanl@87.209.150.214) Quit (Read error: No route to host)
[0:09] * KindOne (~KindOne@0001a7db.user.oftc.net) Quit (Read error: Connection reset by peer)
[0:12] * dpippenger (~riven@tenant.pas.idealab.com) has joined #ceph
[0:12] <joao> gregaf, here
[0:12] <joao> sup?
[0:13] <ishkabob> dmick: any ideas on that injectargs question?
[0:13] <ishkabob> :):):)
[0:13] <gregaf> mattt hit that weird monitor binding thing
[0:13] <joao> I see
[0:13] <gregaf> guess he just nuked the monitor and re-created since he was early on
[0:13] <joao> well, it still is the best solution I've got for that problem anyway
[0:14] <joao> I wish we could find that one poor guy whose luck just ran out and managed to hit that bug every time
[0:14] <joao> maybe then we could find a way to reproduce the issue and fix it
[0:15] <cmdrk> so I'm doing a bit of rados benchmarks on my setup. I have 58 OSDs on one machine (MD shelfs attached to PERC cards), seeing about 1000MB/s reads with 32 threads. I see each disk is only reading at about 20MB/s. any thoughts on where the bottleneck is? this is very acceptabe performance of course :) just wondering if it can be pushed further
[0:16] * BillK (~BillK-OFT@124-169-207-19.dyn.iinet.net.au) has joined #ceph
[0:16] <dmick> ishkabob: I'd definitely trust gregaf, and I would think that even if he hadn't said so
[0:16] <dmick> shouldn't be a problem to stop an osd, change config, and restart, tho
[0:17] <ishkabob> oh shoot, didn't even see that!
[0:17] * Midnightmyth (~quassel@93-167-84-102-static.dk.customer.tdc.net) Quit (Read error: Operation timed out)
[0:17] <ishkabob> thanks gregaf!
[0:17] <dmick> joao: see the bug update for some maybe-defensive ideas
[0:17] <LCF> cmdrk: what about writes ? just wonder how fast you can write ?
[0:17] <ishkabob> perhaps a better question would be, how can i tell what the journal aio is currently set to
[0:17] <ishkabob> it says it defaults to false
[0:18] <cmdrk> LCF: 500MB/s writes. I'm using two 200GB intel SSDs in RAID 0 for my journals, and I see them writing at ~500MB/s in iostat during write benchmarks, so I think that's my bottleneck there.
[0:19] <dmick> ceph daemon osd.N config show should dump everything (or you can config get journal_aio specifically)
[0:19] <ishkabob> dmick: thanks yeah, i just saw that
[0:19] <LCF> I just finish building 5 node cluster, each one got 6x600GB SSD
[0:19] <ishkabob> looks like its already set to true
[0:19] <ishkabob> even though its not in the ceph.conf
[0:19] <LCF> and I'm wonder what performance I should expect
[0:19] * andreask (~andreask@h081217135028.dyn.cm.kabsi.at) has joined #ceph
[0:19] * ChanServ sets mode +v andreask
[0:19] <LCF> osd per one ssd
[0:20] <joao> dmick, did your public_addr defined a port?
[0:20] * andreask (~andreask@h081217135028.dyn.cm.kabsi.at) has left #ceph
[0:20] <dmick> I didn't have one configured
[0:20] <dmick> but I'm guessing that if it got corrupted in mem, it might look as though it were set
[0:20] <gregaf> ishkabob: looking at the source, aio defaults to true
[0:21] <dmick> ...but something turns it off, IIRC
[0:21] <gregaf> if you saw it listed differently elsewhere, we need to poke our doc guy
[0:21] <dmick> (at least sometimes)
[0:22] <gregaf> it gets turned off if it's not compatible — not a block device, or if directio is disabled for some reason (also defaults true; don't think it gets turned off very easily)
[0:22] <dmick> not a block dev is probably what I'm remembering
[0:23] * KindOne (~KindOne@0001a7db.user.oftc.net) has joined #ceph
[0:23] * dmsimard1 (~Adium@108.163.152.2) Quit (Quit: Leaving.)
[0:24] <cmdrk> LCF: i imagine quite fast :) what are you seeing?
[0:24] <cmdrk> also what are the interconnects between the nodes?
[0:24] * ishkabob (~c7a82cc0@webuser.thegrebs.com) Quit (Quit: TheGrebs.com CGI:IRC (Ping timeout))
[0:28] * diegows (~diegows@200.68.116.185) Quit (Read error: Operation timed out)
[0:29] <terje-> hi, I set the wrong IP for my console proxy novncproxy_base_url
[0:30] <terje-> heh, wrong chan. nevermind. :)
[0:30] * Tamil1 (~Adium@cpe-108-184-71-119.socal.res.rr.com) Quit (Quit: Leaving.)
[0:30] * davidzlap (~Adium@ip68-5-239-214.oc.oc.cox.net) has joined #ceph
[0:34] * AfC (~andrew@2407:7800:200:1011:2ad2:44ff:fe08:a4c) has joined #ceph
[0:34] * sprachgenerator (~sprachgen@130.202.135.225) Quit (Quit: sprachgenerator)
[0:34] * Tamil1 (~Adium@cpe-108-184-71-119.socal.res.rr.com) has joined #ceph
[0:43] * malcolm (~malcolm@silico24.lnk.telstra.net) has joined #ceph
[0:49] <LCF> cmdrk: 10gbit between nodes
[0:50] <LCF> cmdrk: didn't test yet, wonder how many nodes I need to create test
[0:50] <LCF> *clients
[0:51] <LCF> need to copy 7.3TB from current storage into ceph
[0:51] <LCF> and then handle daily traffic
[0:51] * KevinPerks (~Adium@cpe-066-026-252-218.triad.res.rr.com) Quit (Quit: Leaving.)
[0:53] * AfC (~andrew@2407:7800:200:1011:2ad2:44ff:fe08:a4c) Quit (Quit: Leaving.)
[0:55] * AfC (~andrew@2407:7800:200:1011:2ad2:44ff:fe08:a4c) has joined #ceph
[0:55] * yanzheng (~zhyan@101.82.251.201) has joined #ceph
[0:56] * MarkN (~nathan@142.208.70.115.static.exetel.com.au) has joined #ceph
[0:56] * MarkN (~nathan@142.208.70.115.static.exetel.com.au) has left #ceph
[1:01] * sagelap (~sage@75.sub-70-195-192.myvzw.com) has joined #ceph
[1:04] * doxavore (~doug@99-7-52-88.lightspeed.rcsntx.sbcglobal.net) Quit (Quit: :qa!)
[1:05] * yanzheng (~zhyan@101.82.251.201) Quit (Ping timeout: 480 seconds)
[1:08] * bandrus (~Adium@cpe-76-95-217-129.socal.res.rr.com) Quit (Quit: Leaving.)
[1:09] * sagelap (~sage@75.sub-70-195-192.myvzw.com) Quit (Read error: Operation timed out)
[1:18] * KevinPerks (~Adium@cpe-066-026-252-218.triad.res.rr.com) has joined #ceph
[1:25] * Guest7205 (~a@209.12.169.218) Quit (Remote host closed the connection)
[1:27] * gregmark (~Adium@68.87.42.115) Quit (Quit: Leaving.)
[1:29] * rudolfsteiner (~federicon@200.68.116.185) Quit (Quit: rudolfsteiner)
[1:31] <xarses> anyone done radosgw on centos/rhel?
[1:38] * carif (~mcarifio@pool-96-233-32-122.bstnma.fios.verizon.net) has joined #ceph
[1:47] * BManojlovic (~steki@fo-d-130.180.254.37.targo.rs) Quit (Quit: Ja odoh a vi sta 'ocete...)
[1:48] <xarses> no one then?
[1:48] * Cube (~Cube@66-87-65-200.pools.spcsdns.net) has joined #ceph
[1:50] <malcolm> I've done everything except radosgw
[1:50] * nwat (~nwat@eduroam-237-79.ucsc.edu) Quit (Ping timeout: 480 seconds)
[1:50] <xarses> I don't see any reasonable package for mod_fastcgi
[1:51] <xarses> mod_fcgid is similar, but I'm not sure
[1:52] <malcolm> http://www.apachelounge.com/viewtopic.php?t=4385
[1:52] <malcolm> Similar but not the same
[1:54] <malcolm> But most people using mod_fastcgi as compling from source. So.. your call.
[1:54] <xarses> ya
[1:55] <xarses> but at that rate, wouldn't something like nginx do this better?
[1:55] * alram (~alram@38.122.20.226) Quit (Quit: leaving)
[1:56] <malcolm> possibly. I've never had performace issues with a decently tuned apache box tho.
[1:56] <xarses> also, If I'm going to compile, should i use https://github.com/ceph/mod_fastcgi ?
[1:57] <malcolm> I would
[1:57] <malcolm> Looks like it has some RADOS specific fixes.
[2:01] * kraken (~kraken@c-24-131-46-23.hsd1.ga.comcast.net) Quit (Ping timeout: 480 seconds)
[2:04] <malcolm> Looking at things I'd be using this one.. mod_fcgid doesn't look like the right fit for a radosgw
[2:05] <xarses> Ok, I'll poke around mod_fcgid for a bit
[2:05] <xarses> and go from there
[2:05] <xarses> appreciate the help
[2:07] <xarses> hmm, should service radosgw start not return anything?
[2:07] * DarkAceZ (~BillyMays@50.107.55.36) Quit (Ping timeout: 480 seconds)
[2:10] * LeaChim (~LeaChim@host86-135-252-168.range86-135.btcentralplus.com) Quit (Ping timeout: 480 seconds)
[2:12] * scuttlemonkey (~scuttlemo@c-69-244-181-5.hsd1.mi.comcast.net) Quit (Read error: Operation timed out)
[2:14] * Tamil1 (~Adium@cpe-108-184-71-119.socal.res.rr.com) has left #ceph
[2:19] * DarkAceZ (~BillyMays@50.107.55.36) has joined #ceph
[2:19] * KevinPerks (~Adium@cpe-066-026-252-218.triad.res.rr.com) Quit (Quit: Leaving.)
[2:25] * sjusthm (~sam@24-205-35-233.dhcp.gldl.ca.charter.com) Quit (Remote host closed the connection)
[2:29] * scuttlemonkey (~scuttlemo@c-69-244-181-5.hsd1.mi.comcast.net) has joined #ceph
[2:29] * ChanServ sets mode +o scuttlemonkey
[2:34] * dmsimard (~Adium@108.163.152.66) has joined #ceph
[2:43] * grepory (~Adium@50-115-70-146.static-ip.telepacific.net) Quit (Quit: Leaving.)
[2:43] * xarses (~andreww@204.11.231.50.static.etheric.net) Quit (Ping timeout: 480 seconds)
[2:46] * sjustlaptop1 (~sam@24-205-35-233.dhcp.gldl.ca.charter.com) has joined #ceph
[2:48] * dmsimard (~Adium@108.163.152.66) Quit (Ping timeout: 480 seconds)
[2:50] * KevinPerks (~Adium@cpe-066-026-252-218.triad.res.rr.com) has joined #ceph
[2:52] * sjustlaptop (~sam@24-205-35-233.dhcp.gldl.ca.charter.com) Quit (Ping timeout: 480 seconds)
[2:52] * nwat (~nwat@eduroam-237-79.ucsc.edu) has joined #ceph
[2:55] * KindTwo (~KindOne@198.14.203.252) has joined #ceph
[2:56] * KindOne (~KindOne@0001a7db.user.oftc.net) Quit (Ping timeout: 480 seconds)
[2:56] * KindTwo is now known as KindOne
[3:01] * xarses (~andreww@c-71-202-167-197.hsd1.ca.comcast.net) has joined #ceph
[3:01] * KevinPerks (~Adium@cpe-066-026-252-218.triad.res.rr.com) Quit (Read error: Operation timed out)
[3:05] * nwat (~nwat@eduroam-237-79.ucsc.edu) Quit (Ping timeout: 480 seconds)
[3:17] * carif (~mcarifio@pool-96-233-32-122.bstnma.fios.verizon.net) Quit (Quit: Ex-Chat)
[3:17] * Vjarjadian (~IceChat77@94.15.107.254) Quit (Ping timeout: 480 seconds)
[3:20] * Cube (~Cube@66-87-65-200.pools.spcsdns.net) Quit (Quit: Leaving.)
[3:22] * KindOne (~KindOne@0001a7db.user.oftc.net) Quit (Read error: Connection reset by peer)
[3:28] * KindOne (~KindOne@0001a7db.user.oftc.net) has joined #ceph
[3:36] * dpippenger (~riven@tenant.pas.idealab.com) Quit (Quit: Leaving.)
[3:39] * houkouonchi-datacenter (~linux@gw.sepia.ceph.com) Quit (Remote host closed the connection)
[3:41] * Cube (~Cube@66-87-65-200.pools.spcsdns.net) has joined #ceph
[3:42] * malcolm (~malcolm@silico24.lnk.telstra.net) Quit (Quit: Konversation terminated!)
[3:42] * malcolm (~malcolm@silico24.lnk.telstra.net) has joined #ceph
[3:44] * angdraug (~angdraug@204.11.231.50.static.etheric.net) Quit (Quit: Leaving)
[3:45] * Cube (~Cube@66-87-65-200.pools.spcsdns.net) Quit ()
[3:53] * yanzheng (~zhyan@101.83.169.23) has joined #ceph
[4:01] * mnash (~chatzilla@66-194-114-178.static.twtelecom.net) Quit (Ping timeout: 480 seconds)
[4:01] * yanzheng (~zhyan@101.83.169.23) Quit (Ping timeout: 480 seconds)
[4:22] * ShaunR (~ShaunR@staff.ndchost.com) Quit (Ping timeout: 480 seconds)
[4:22] * ShaunR (~ShaunR@staff.ndchost.com) has joined #ceph
[4:35] * sagelap (~sage@2600:1011:b102:3fb7:5d87:a217:ebf3:f605) has joined #ceph
[4:37] * malcolm (~malcolm@silico24.lnk.telstra.net) Quit (Quit: Konversation terminated!)
[4:37] * malcolm (~malcolm@silico24.lnk.telstra.net) has joined #ceph
[4:41] * malcolm (~malcolm@silico24.lnk.telstra.net) Quit ()
[4:41] * malcolm (~malcolm@silico24.lnk.telstra.net) has joined #ceph
[4:49] * malcolm_ (~malcolm@silico24.lnk.telstra.net) has joined #ceph
[4:57] * malcolm (~malcolm@silico24.lnk.telstra.net) Quit (Ping timeout: 480 seconds)
[4:58] * Cube (~Cube@66-87-65-200.pools.spcsdns.net) has joined #ceph
[5:00] * mnash (~chatzilla@vpn.expressionanalysis.com) has joined #ceph
[5:03] * fireD_ (~fireD@93-139-128-199.adsl.net.t-com.hr) Quit (Read error: Operation timed out)
[5:05] * fireD (~fireD@93-139-164-60.adsl.net.t-com.hr) has joined #ceph
[5:22] * yanzheng (~zhyan@101.83.195.178) has joined #ceph
[5:30] * yanzheng (~zhyan@101.83.195.178) Quit (Read error: Operation timed out)
[5:32] * jcsp (~john@82-71-55-202.dsl.in-addr.zen.co.uk) Quit (Ping timeout: 480 seconds)
[6:05] * wusui (~Warren@2607:f298:a:607:956:fb3f:2383:3023) has joined #ceph
[6:05] * jjgalvez (~jjgalvez@ip72-193-217-254.lv.lv.cox.net) Quit (Read error: Connection reset by peer)
[6:05] * jjgalvez (~jjgalvez@ip72-193-217-254.lv.lv.cox.net) has joined #ceph
[6:11] * aardvark (~Warren@2607:f298:a:607:956:fb3f:2383:3023) Quit (Ping timeout: 480 seconds)
[6:11] * nwat (~nwat@c-50-131-197-174.hsd1.ca.comcast.net) has joined #ceph
[6:13] * sagelap (~sage@2600:1011:b102:3fb7:5d87:a217:ebf3:f605) Quit (Ping timeout: 480 seconds)
[6:13] * carif (~mcarifio@cpe-74-78-54-137.maine.res.rr.com) has joined #ceph
[6:19] * dpippenger (~riven@cpe-76-166-208-83.socal.res.rr.com) has joined #ceph
[6:21] * xmltok (~xmltok@cpe-76-170-26-114.socal.res.rr.com) Quit (Quit: Bye!)
[6:30] * nwat (~nwat@c-50-131-197-174.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[6:36] * gucki (~smuxi@HSI-KBW-109-192-187-143.hsi6.kabel-badenwuerttemberg.de) has joined #ceph
[6:45] * mech4221 (~steve@ip68-2-159-8.ph.ph.cox.net) Quit (Quit: Leaving.)
[6:45] * haomaiwa_ (~haomaiwan@117.79.232.194) has joined #ceph
[6:45] * haomaiwang (~haomaiwan@117.79.232.211) Quit (Read error: Connection reset by peer)
[6:51] * sjustlaptop1 (~sam@24-205-35-233.dhcp.gldl.ca.charter.com) Quit (Ping timeout: 480 seconds)
[7:43] * nwat (~nwat@c-50-131-197-174.hsd1.ca.comcast.net) has joined #ceph
[8:00] * Cube (~Cube@66-87-65-200.pools.spcsdns.net) Quit (Ping timeout: 480 seconds)
[8:07] * rturk-away is now known as rturk
[8:07] * rturk is now known as rturk-away
[8:20] * rendar (~s@95.238.179.129) has joined #ceph
[8:27] * madkiss (~madkiss@2001:6f8:12c3:f00f:6041:5086:4359:10ab) Quit (Read error: Network is unreachable)
[8:31] * shang (~ShangWu@122-116-16-162.HINET-IP.hinet.net) Quit (Remote host closed the connection)
[8:31] * madkiss (~madkiss@chello062178057005.20.11.vie.surfer.at) has joined #ceph
[8:44] <ccourtaut> morning!
[8:50] * nwat (~nwat@c-50-131-197-174.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[8:58] * sagelap (~sage@2600:1010:b015:6e39:5d87:a217:ebf3:f605) has joined #ceph
[8:59] * jcfischer (~fischer@130.59.94.159) has joined #ceph
[9:03] * jcfischer (~fischer@130.59.94.159) Quit (Read error: Connection reset by peer)
[9:04] * jcfischer (~fischer@130.59.94.159) has joined #ceph
[9:04] * odyssey4me (~odyssey4m@165.233.71.2) has joined #ceph
[9:07] * thomnico (~thomnico@2a01:e35:8b41:120:40bd:43f8:c1b6:5f00) has joined #ceph
[9:09] * jcfischer_ (~fischer@user-23-14.vpn.switch.ch) has joined #ceph
[9:09] * sagelap (~sage@2600:1010:b015:6e39:5d87:a217:ebf3:f605) Quit (Read error: No route to host)
[9:12] * jcfischer (~fischer@130.59.94.159) Quit (Ping timeout: 480 seconds)
[9:12] * jcfischer_ is now known as jcfischer
[9:24] * BManojlovic (~steki@91.195.39.5) has joined #ceph
[9:26] * andreask (~andreask@h081217135028.dyn.cm.kabsi.at) has joined #ceph
[9:26] * ChanServ sets mode +v andreask
[9:38] * negronjl (~negronjl@softbank126112054050.biz.bbtec.net) has joined #ceph
[9:38] * negronjl (~negronjl@softbank126112054050.biz.bbtec.net) Quit ()
[9:40] * mattrae (~oftc-webi@softbank126112054050.biz.bbtec.net) has joined #ceph
[9:40] * AfC (~andrew@2407:7800:200:1011:2ad2:44ff:fe08:a4c) Quit (Quit: Leaving.)
[9:46] * WarrenUsui (~Warren@2607:f298:a:607:956:fb3f:2383:3023) Quit (Read error: Connection reset by peer)
[9:46] * wusui (~Warren@2607:f298:a:607:956:fb3f:2383:3023) Quit (Read error: Connection reset by peer)
[9:48] * WarrenUsui (~Warren@38.122.20.226) has joined #ceph
[9:48] * wusui (~Warren@38.122.20.226) has joined #ceph
[9:51] * wusui (~Warren@38.122.20.226) Quit (Read error: Connection reset by peer)
[9:51] * WarrenUsui (~Warren@38.122.20.226) Quit (Read error: Connection reset by peer)
[9:52] * Tamil (~tamil@38.122.20.226) Quit (Read error: Connection reset by peer)
[9:52] * nwat (~nwat@c-50-131-197-174.hsd1.ca.comcast.net) has joined #ceph
[9:53] * joshd (~joshd@2607:f298:a:607:221:70ff:fe33:3fe3) Quit (Ping timeout: 480 seconds)
[9:53] * gregaf (~Adium@2607:f298:a:607:2026:a478:8d61:dbdf) Quit (Ping timeout: 480 seconds)
[9:53] * sagewk (~sage@2607:f298:a:607:219:b9ff:fe40:55fe) Quit (Ping timeout: 480 seconds)
[9:54] * yehudasa (~yehudasa@2607:f298:a:607:d6be:d9ff:fe8e:174c) Quit (Ping timeout: 480 seconds)
[9:54] * sjust (~sam@2607:f298:a:607:baac:6fff:fe83:5a02) Quit (Ping timeout: 480 seconds)
[9:55] * dmick (~dmick@2607:f298:a:607:122:7863:5ab6:d460) Quit (Ping timeout: 480 seconds)
[9:57] * freedomhui (~freedomhu@211.155.113.239) has joined #ceph
[10:00] * nwat (~nwat@c-50-131-197-174.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[10:00] * shang (~ShangWu@122-116-16-162.HINET-IP.hinet.net) has joined #ceph
[10:01] * malcolm_ (~malcolm@silico24.lnk.telstra.net) Quit (Read error: Operation timed out)
[10:01] * wusui (~Warren@38.122.20.226) has joined #ceph
[10:02] * aardvark (~Warren@38.122.20.226) has joined #ceph
[10:03] * davidzlap (~Adium@ip68-5-239-214.oc.oc.cox.net) Quit (Quit: Leaving.)
[10:05] * wusui (~Warren@38.122.20.226) Quit (Read error: Connection reset by peer)
[10:05] * aardvark (~Warren@38.122.20.226) Quit (Read error: Connection reset by peer)
[10:07] * mattrae (~oftc-webi@softbank126112054050.biz.bbtec.net) Quit (Quit: Page closed)
[10:13] * wusui (~Warren@38.122.20.226) has joined #ceph
[10:13] * joshd (~joshd@2607:f298:a:607:221:70ff:fe33:3fe3) has joined #ceph
[10:13] * aardvark (~Warren@2607:f298:a:607:956:fb3f:2383:3023) has joined #ceph
[10:13] * yehudasa (~yehudasa@2607:f298:a:607:d6be:d9ff:fe8e:174c) has joined #ceph
[10:13] * Tamil (~tamil@38.122.20.226) has joined #ceph
[10:16] * Cube (~Cube@cpe-76-95-217-129.socal.res.rr.com) has joined #ceph
[10:17] * sagewk (~sage@2607:f298:a:607:219:b9ff:fe40:55fe) has joined #ceph
[10:20] * sjust (~sam@2607:f298:a:607:baac:6fff:fe83:5a02) has joined #ceph
[10:24] * al (quassel@niel.cx) Quit ()
[10:24] * al (d@niel.cx) has joined #ceph
[10:28] * mattrae (~oftc-webi@softbank126112054050.biz.bbtec.net) has joined #ceph
[10:28] * LeaChim (~LeaChim@host86-135-252-168.range86-135.btcentralplus.com) has joined #ceph
[10:28] <mattrae> hi, when i added additional osds i see the original osds doing just as much writing as the new osds.. is that expected during rebalancing?
[10:29] <mattrae> i'd expect to see primarily reads off the original osds to replice to the new osds
[10:41] * allsystemsarego (~allsystem@188.25.131.49) has joined #ceph
[10:41] * jbd_ (~jbd_@2001:41d0:52:a00::77) has left #ceph
[10:41] * jbd_ (~jbd_@2001:41d0:52:a00::77) has joined #ceph
[10:42] * mattrae (~oftc-webi@softbank126112054050.biz.bbtec.net) Quit (Remote host closed the connection)
[10:47] * fretb (~fretb@frederik.pw) Quit (Quit: leaving)
[10:48] * fretb (~fretb@frederik.pw) has joined #ceph
[10:48] * fretb (~fretb@frederik.pw) Quit ()
[10:48] * fretb (~fretb@frederik.pw) has joined #ceph
[10:50] * mattt_ (~mattt@92.52.76.140) has joined #ceph
[10:53] <mattt_> hi all, what should be writing to /var/lib/ceph/radosgw ?
[10:53] <mattt_> that dir is empty on my host
[10:54] <mattt_> let me rephrase, what does radosgw write there? :)
[10:58] * ScOut3R (~scout3r@540099D1.dsl.pool.telekom.hu) has joined #ceph
[11:00] * dmick (~dmick@2607:f298:a:607:b02b:7a3f:8417:b388) has joined #ceph
[11:14] <mattt_> what i'm seeing is that radosgw isn't caching any keystone tokens
[11:14] <mattt_> so we're hammering keystone on each request
[11:20] * claenjoy (~leggenda@37.157.33.36) has joined #ceph
[11:47] * madkiss (~madkiss@chello062178057005.20.11.vie.surfer.at) Quit (Quit: Leaving.)
[11:51] * yanzheng (~zhyan@134.134.139.70) has joined #ceph
[12:07] * andreask (~andreask@h081217135028.dyn.cm.kabsi.at) Quit (Ping timeout: 480 seconds)
[12:09] * JustEra (~JustEra@89.234.148.11) has joined #ceph
[12:15] <JustEra> Hello I've a mon down and the only "error" is "-1 failed to create new leveldb store" what can I do ?
[12:19] * Guest6943 (~coyo@thinks.outside.theb0x.org) Quit (Ping timeout: 480 seconds)
[12:21] * HauM1 (~HauM1@login.univie.ac.at) has joined #ceph
[12:27] * Cube (~Cube@cpe-76-95-217-129.socal.res.rr.com) Quit (Quit: Leaving.)
[12:30] * thomnico (~thomnico@2a01:e35:8b41:120:40bd:43f8:c1b6:5f00) Quit (Quit: Ex-Chat)
[12:33] * andreask (~andreask@h081217135028.dyn.cm.kabsi.at) has joined #ceph
[12:33] * ChanServ sets mode +v andreask
[12:36] * freedomhui (~freedomhu@211.155.113.239) Quit (Quit: Leaving...)
[12:44] * andreask (~andreask@h081217135028.dyn.cm.kabsi.at) Quit (Ping timeout: 480 seconds)
[12:47] * thomnico (~thomnico@2a01:e35:8b41:120:40bd:43f8:c1b6:5f00) has joined #ceph
[12:49] * freedomhui (~freedomhu@117.79.232.238) has joined #ceph
[12:56] * freedomhui (~freedomhu@117.79.232.238) Quit (Quit: Leaving...)
[13:18] * andreask (~andreask@h081217135028.dyn.cm.kabsi.at) has joined #ceph
[13:18] * ChanServ sets mode +v andreask
[13:20] <joao> JustEra, create the mon data dir prior to mkfs
[13:20] <joao> I'm assuming you're adding a new monitor, and are deploying manually
[13:20] <joao> afaicr, that's the only scenario in which the mon would actually not start with that error
[13:21] <joao> ls /var/lib/ceph/mon/ceph-ID
[13:21] <joao> if that doesn't exist, that's your problem; if it does, rerun the monitor with 'debug mon = 10' and pastebin the log
[13:22] <JustEra> joao, nah was setting cephfs with a news keyring and a mon started to shutdown and :(
[13:24] <joao> that's awfully strange
[13:24] <joao> grep the log for 'ASSERT'?
[13:25] <JustEra> joao, It's was a dev setup already wiped sorry :(
[13:25] <joao> so no longer seeing that?
[13:25] <JustEra> yeah
[13:26] <joao> next time this happens, please set 'debug mon = 10', 'debug ms = 1' and 'debug paxos = 10', restart, let the monitor hit that issue again, upload the log and point us to it
[13:26] <joao> btw, which version are you running?
[13:26] <JustEra> 0.63.7
[13:27] <joao> no such thing I'm sure
[13:27] <joao> .63 is a dev release
[13:27] <JustEra> 0.67.3 my bad
[13:28] <joao> kay
[13:28] <joao> weird
[13:28] <joao> don't remember seeing that happen
[13:28] <joao> let me know if you hit that again
[13:28] <joao> now to fix some lunch
[13:28] <joao> brb
[13:29] <JustEra> It was already in mon_debug = 10 btw let me grep some log in my shell console
[13:29] <JustEra> 2013-09-20 12:15:40.647707 7fd76c515700 1 mon.bijou@2(electing).elector(161) init, last seen epoch 16
[13:29] <JustEra> infinite loop with that
[13:35] * freedomhui (~freedomhu@117.79.232.238) has joined #ceph
[13:38] * andreask (~andreask@h081217135028.dyn.cm.kabsi.at) has left #ceph
[13:40] <JustEra> joao, tell me when you a there was doing a clean reinstall and got the same result
[13:51] * thomnico (~thomnico@2a01:e35:8b41:120:40bd:43f8:c1b6:5f00) Quit (Quit: Ex-Chat)
[13:52] <JustEra> if someone can help me http://pastebin.com/kRxBN9Yr
[13:53] * sprachgenerator (~sprachgen@c-50-141-192-36.hsd1.il.comcast.net) has joined #ceph
[13:54] * sleinen (~Adium@2001:620:0:26:5465:f6ea:3794:1e4a) has joined #ceph
[13:57] * yanzheng (~zhyan@134.134.139.70) Quit (Remote host closed the connection)
[14:00] * sprachgenerator (~sprachgen@c-50-141-192-36.hsd1.il.comcast.net) Quit (Quit: sprachgenerator)
[14:01] * sprachgenerator (~sprachgen@c-50-141-192-36.hsd1.il.comcast.net) has joined #ceph
[14:02] * alfredodeza (~alfredode@c-24-131-46-23.hsd1.ga.comcast.net) has joined #ceph
[14:02] * kraken (~kraken@c-24-131-46-23.hsd1.ga.comcast.net) has joined #ceph
[14:04] * thomnico (~thomnico@2a01:e35:8b41:120:40bd:43f8:c1b6:5f00) has joined #ceph
[14:07] * yanzheng (~zhyan@jfdmzpr04-ext.jf.intel.com) has joined #ceph
[14:15] * KevinPerks (~Adium@cpe-066-026-252-218.triad.res.rr.com) has joined #ceph
[14:15] * freedomhui (~freedomhu@117.79.232.238) Quit (Quit: Leaving...)
[14:21] * freedomhui (~freedomhu@211.155.113.204) has joined #ceph
[14:21] * jcfischer (~fischer@user-23-14.vpn.switch.ch) Quit (Ping timeout: 480 seconds)
[14:48] * portante (~portante@nat-pool-bos-t.redhat.com) has left #ceph
[15:15] * alexxy[home] (~alexxy@79.173.81.171) Quit (Remote host closed the connection)
[15:17] * jluis (~joao@89-181-152-211.net.novis.pt) has joined #ceph
[15:17] * ChanServ sets mode +o jluis
[15:24] * joao (~joao@89-181-152-211.net.novis.pt) Quit (Ping timeout: 480 seconds)
[15:24] * alexxy (~alexxy@2001:470:1f14:106::2) has joined #ceph
[15:28] * jluis is now known as joao
[15:28] <joao> JustEra, how many monitors do you have?
[15:29] <JustEra> joao, 3 monitors , and I've that error now librados: client.admin authentication error (110) Connection timed out
[15:36] <joao> my guess is that the monitors are not forming quorum
[15:36] <joao> drop the logs somewhere so I can take a look?
[15:38] * sprachgenerator (~sprachgen@c-50-141-192-36.hsd1.il.comcast.net) Quit (Quit: sprachgenerator)
[15:40] * dmsimard (~Adium@70.38.0.245) has joined #ceph
[15:47] * sprachgenerator (~sprachgen@c-50-141-192-36.hsd1.il.comcast.net) has joined #ceph
[15:53] * sprachgenerator (~sprachgen@c-50-141-192-36.hsd1.il.comcast.net) Quit (Quit: sprachgenerator)
[15:53] * dmsimard1 (~Adium@108.163.152.2) has joined #ceph
[15:56] * dmsimard (~Adium@70.38.0.245) Quit (Read error: Connection reset by peer)
[16:06] * mnash (~chatzilla@vpn.expressionanalysis.com) Quit (Ping timeout: 480 seconds)
[16:07] <JustEra> joao, http://pastebin.com/R4tMsRHv
[16:09] * alfredodeza (~alfredode@c-24-131-46-23.hsd1.ga.comcast.net) has left #ceph
[16:10] * hybrid512 (~walid@LPoitiers-156-86-25-85.w193-248.abo.wanadoo.fr) Quit (Quit: Leaving.)
[16:17] * mikedawson (~chatzilla@23-25-46-97-static.hfc.comcastbusiness.net) has joined #ceph
[16:18] * mnash (~chatzilla@vpn.expressionanalysis.com) has joined #ceph
[16:19] * nwat (~nwat@c-50-131-197-174.hsd1.ca.comcast.net) has joined #ceph
[16:20] * BillK (~BillK-OFT@124-169-207-19.dyn.iinet.net.au) Quit (Quit: ZNC - http://znc.in)
[16:20] * hybrid512 (~walid@LPoitiers-156-86-25-85.w193-248.abo.wanadoo.fr) has joined #ceph
[16:22] <joao> JustEra, I meant the actual mon logs
[16:22] <joao> ideally with 'debug mon = 10'
[16:30] * hybrid512 (~walid@LPoitiers-156-86-25-85.w193-248.abo.wanadoo.fr) Quit (Quit: Leaving.)
[16:30] * hybrid512 (~walid@LPoitiers-156-86-25-85.w193-248.abo.wanadoo.fr) has joined #ceph
[16:31] * hybrid512 (~walid@LPoitiers-156-86-25-85.w193-248.abo.wanadoo.fr) Quit ()
[16:32] * hybrid512 (~walid@LPoitiers-156-86-25-85.w193-248.abo.wanadoo.fr) has joined #ceph
[16:34] * jnq (~jon@0001b7cc.user.oftc.net) Quit (Quit: WeeChat 0.3.7)
[16:35] <mikedawson> joao: should 'ceph heap stats' work on 0.67.3? http://pastebin.com/raw.php?i=4d32Sv5c
[16:35] <joao> mikedawson, it should
[16:35] <joao> hmmm
[16:35] <joao> weird
[16:36] <mikedawson> hmmm, maybe this is a dmick issue
[16:36] <joao> mikedawson, add 'debug monc = 10' to ceph.conf and rerun?
[16:36] * wschulze (~wschulze@ip-64-134-229-47.public.wayport.net) has joined #ceph
[16:37] <mikedawson> joao: http://pastebin.com/raw.php?i=STqVZHAB
[16:38] <joao> let me check the code
[16:38] <mikedawson> joao: thx
[16:38] * jnq (~jon@198.199.79.59) has joined #ceph
[16:39] * jnq (~jon@198.199.79.59) Quit ()
[16:39] * yanzheng (~zhyan@jfdmzpr04-ext.jf.intel.com) Quit (Quit: Leaving)
[16:40] * jnq (~jon@198.199.79.59) has joined #ceph
[16:40] * JustEra (~JustEra@89.234.148.11) Quit (Ping timeout: 480 seconds)
[16:41] <mikedawson> joao: ceph tell mon.0 heap stats seems to fail the same way
[16:42] <joao> yeah, I believe I figured out why
[16:42] <joao> just need to make sure
[16:42] * yanzheng (~zhyan@101.82.125.204) has joined #ceph
[16:42] <joao> mikedawson, try 'heap stats stats'
[16:42] <joao> I don't think that's gonna be parsed though
[16:43] <mikedawson> joao: for 'ceph heap stats stats', I get -> Invalid command: unused arguments: ['stats']
[16:44] <joao> yeah, just another sec
[16:47] <joao> yeah, we should have a unit test for this
[16:47] <joao> got the issue
[16:47] <joao> opening a ticket
[16:47] <joao> thanks
[16:50] <mikedawson> great! thanks, joao!
[16:53] <joao> mikedawson, issue 6361
[16:53] <kraken> joao might be talking about: http://tracker.ceph.com/issues/6361 [mon: 'heap' commands not working]
[17:03] * wschulze1 (~wschulze@107.18.186.32) has joined #ceph
[17:06] * sagelap (~sage@c-67-180-199-38.hsd1.ca.comcast.net) has joined #ceph
[17:06] * wschulze (~wschulze@ip-64-134-229-47.public.wayport.net) Quit (Read error: Operation timed out)
[17:10] * sprachgenerator (~sprachgen@130.202.135.201) has joined #ceph
[17:12] * grepory (~Adium@50-115-70-146.static-ip.telepacific.net) has joined #ceph
[17:20] * wschulze1 (~wschulze@107.18.186.32) Quit (Quit: Leaving.)
[17:21] * xarses (~andreww@c-71-202-167-197.hsd1.ca.comcast.net) Quit (Read error: Operation timed out)
[17:21] * rudolfsteiner (~federicon@200.68.116.185) has joined #ceph
[17:24] * BManojlovic (~steki@91.195.39.5) Quit (Quit: Ja odoh a vi sta 'ocete...)
[17:25] * diegows (~diegows@190.190.11.42) has joined #ceph
[17:26] * sagelap1 (~sage@239.sub-70-197-4.myvzw.com) has joined #ceph
[17:27] * sagelap (~sage@c-67-180-199-38.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[17:30] * lxo (~aoliva@lxo.user.oftc.net) Quit (Remote host closed the connection)
[17:35] * xmltok (~xmltok@cpe-76-170-26-114.socal.res.rr.com) has joined #ceph
[17:38] * yanzheng (~zhyan@101.82.125.204) Quit (Ping timeout: 480 seconds)
[17:39] * wschulze (~wschulze@50.0.113.66) has joined #ceph
[17:42] * davidzlap (~Adium@ip68-5-239-214.oc.oc.cox.net) has joined #ceph
[17:43] * lxo (~aoliva@lxo.user.oftc.net) has joined #ceph
[17:43] * xarses (~andreww@204.11.231.50.static.etheric.net) has joined #ceph
[17:49] * sagelap1 is now known as sagelap
[17:51] * glzhao (~glzhao@118.195.65.67) has joined #ceph
[17:51] * yanzheng (~zhyan@101.82.125.204) has joined #ceph
[17:55] * wschulze (~wschulze@50.0.113.66) Quit (Read error: Connection reset by peer)
[17:55] * wschulze1 (~wschulze@50.0.113.66) has joined #ceph
[17:57] * markbby (~Adium@168.94.245.4) has joined #ceph
[17:59] * yanzheng (~zhyan@101.82.125.204) Quit (Ping timeout: 480 seconds)
[18:00] * yanzheng (~zhyan@101.82.172.54) has joined #ceph
[18:03] * shang (~ShangWu@122-116-16-162.HINET-IP.hinet.net) Quit (Read error: Operation timed out)
[18:06] * mnash (~chatzilla@vpn.expressionanalysis.com) Quit (Ping timeout: 480 seconds)
[18:06] * mnash_ (~chatzilla@66-194-114-178.static.twtelecom.net) has joined #ceph
[18:06] * mnash_ is now known as mnash
[18:08] * Coyo (~coyo@thinks.outside.theb0x.org) has joined #ceph
[18:09] * Coyo is now known as Guest7276
[18:12] * davidzlap1 (~Adium@ip68-5-239-214.oc.oc.cox.net) has joined #ceph
[18:12] * davidzlap (~Adium@ip68-5-239-214.oc.oc.cox.net) Quit (Read error: Connection reset by peer)
[18:12] * mattt_ (~mattt@92.52.76.140) Quit (Read error: Connection reset by peer)
[18:12] * bandrus (~Adium@cpe-76-95-217-129.socal.res.rr.com) has joined #ceph
[18:12] * lxo (~aoliva@lxo.user.oftc.net) Quit (Remote host closed the connection)
[18:12] * lxo (~aoliva@lxo.user.oftc.net) has joined #ceph
[18:15] * allsystemsarego (~allsystem@188.25.131.49) Quit (Quit: Leaving)
[18:15] * ScOut3R (~scout3r@540099D1.dsl.pool.telekom.hu) Quit (Remote host closed the connection)
[18:15] * freedomhui (~freedomhu@211.155.113.204) Quit (Quit: Leaving...)
[18:16] * yanzheng (~zhyan@101.82.172.54) Quit (Ping timeout: 480 seconds)
[18:21] * lxo (~aoliva@lxo.user.oftc.net) Quit (Quit: later)
[18:26] * BManojlovic (~steki@fo-d-130.180.254.37.targo.rs) has joined #ceph
[18:30] <sjust> ok
[18:37] * sleinen (~Adium@2001:620:0:26:5465:f6ea:3794:1e4a) Quit (Quit: Leaving.)
[18:37] * sleinen (~Adium@130.59.94.168) has joined #ceph
[18:39] * lxo (~aoliva@lxo.user.oftc.net) has joined #ceph
[18:41] * angdraug (~angdraug@204.11.231.50.static.etheric.net) has joined #ceph
[18:45] * BManojlovic (~steki@fo-d-130.180.254.37.targo.rs) Quit (Quit: Ja odoh a vi sta 'ocete...)
[18:45] * xmltok (~xmltok@cpe-76-170-26-114.socal.res.rr.com) Quit (Remote host closed the connection)
[18:45] * sleinen (~Adium@130.59.94.168) Quit (Ping timeout: 480 seconds)
[18:45] * BManojlovic (~steki@fo-d-130.180.254.37.targo.rs) has joined #ceph
[18:45] * xmltok (~xmltok@pool101.bizrate.com) has joined #ceph
[18:47] <acaos> is there anyone around who's experienced with Ceph tuning with Dumpling (0.67.3) and might be able to offer some advice?
[18:47] * BManojlovic (~steki@fo-d-130.180.254.37.targo.rs) Quit ()
[18:50] * Vjarjadian (~IceChat77@05452710.skybroadband.com) has joined #ceph
[18:50] * BManojlovic (~steki@fo-d-130.180.254.37.targo.rs) has joined #ceph
[18:51] * lxo (~aoliva@lxo.user.oftc.net) Quit (Remote host closed the connection)
[18:52] * lxo (~aoliva@lxo.user.oftc.net) has joined #ceph
[18:57] * lxo (~aoliva@lxo.user.oftc.net) Quit (Remote host closed the connection)
[18:58] * lxo (~aoliva@lxo.user.oftc.net) has joined #ceph
[19:02] * aardvark (~Warren@2607:f298:a:607:956:fb3f:2383:3023) Quit (Quit: Leaving)
[19:02] * aardvark (~Warren@2607:f298:a:607:956:fb3f:2383:3023) has joined #ceph
[19:03] * lxo (~aoliva@lxo.user.oftc.net) Quit (Remote host closed the connection)
[19:03] * lxo (~aoliva@lxo.user.oftc.net) has joined #ceph
[19:06] * rudolfsteiner (~federicon@200.68.116.185) Quit (Quit: rudolfsteiner)
[19:08] * gregaf (~Adium@2607:f298:a:607:2d01:5eb3:378:d592) has joined #ceph
[19:08] * lxo (~aoliva@lxo.user.oftc.net) Quit (Remote host closed the connection)
[19:08] * lx0 (~aoliva@lxo.user.oftc.net) has joined #ceph
[19:10] * mikedawson (~chatzilla@23-25-46-97-static.hfc.comcastbusiness.net) Quit (Read error: Connection reset by peer)
[19:11] * sleinen (~Adium@77-58-245-10.dclient.hispeed.ch) has joined #ceph
[19:12] * sjustlaptop (~sam@2607:f298:a:607:d841:5658:1f83:1de) has joined #ceph
[19:13] * sagelap (~sage@239.sub-70-197-4.myvzw.com) Quit (Read error: Connection reset by peer)
[19:13] * sleinen1 (~Adium@2001:620:0:26:f07f:787d:69ab:941b) has joined #ceph
[19:15] * odyssey4me (~odyssey4m@165.233.71.2) Quit (Quit: odyssey4me)
[19:18] * KindTwo (~KindOne@h172.58.186.173.dynamic.ip.windstream.net) has joined #ceph
[19:18] * bandrus (~Adium@cpe-76-95-217-129.socal.res.rr.com) Quit (Quit: Leaving.)
[19:19] * sleinen (~Adium@77-58-245-10.dclient.hispeed.ch) Quit (Ping timeout: 480 seconds)
[19:20] * KindOne (~KindOne@0001a7db.user.oftc.net) Quit (Ping timeout: 480 seconds)
[19:20] * KindTwo is now known as KindOne
[19:21] * bandrus (~Adium@cpe-76-95-217-129.socal.res.rr.com) has joined #ceph
[19:22] * wschulze (~wschulze@50.0.113.66) has joined #ceph
[19:23] * dpippenger (~riven@cpe-76-166-208-83.socal.res.rr.com) Quit (Quit: Leaving.)
[19:23] * wschulze1 (~wschulze@50.0.113.66) Quit (Read error: Connection reset by peer)
[19:23] * wschulze1 (~wschulze@50.0.113.66) has joined #ceph
[19:23] * wschulze (~wschulze@50.0.113.66) Quit (Read error: Connection reset by peer)
[19:25] * thomnico (~thomnico@2a01:e35:8b41:120:40bd:43f8:c1b6:5f00) Quit (Quit: Ex-Chat)
[19:26] * jbd_ (~jbd_@2001:41d0:52:a00::77) has left #ceph
[19:29] * wschulze (~wschulze@50.0.113.66) has joined #ceph
[19:29] * wschulze1 (~wschulze@50.0.113.66) Quit (Read error: Connection reset by peer)
[19:44] * yehuda_hm (~yehuda@2602:306:330b:1410:baac:6fff:fec5:2aad) has joined #ceph
[19:48] * ScOut3R (~scout3r@540099D1.dsl.pool.telekom.hu) has joined #ceph
[19:56] * markbby (~Adium@168.94.245.4) Quit (Quit: Leaving.)
[19:57] * nagyz (~nagyz@178-83-84-204.dynamic.hispeed.ch) has joined #ceph
[19:57] <nagyz> hi folks
[19:58] * sagelap (~sage@2600:1010:b01c:9cea:8902:c697:3fb4:543d) has joined #ceph
[19:58] <nagyz> just wanted to say: great work on ceph!
[19:58] <nagyz> I'll have a test environment hopefully in the next 1-2 weeks to give it a spin in a larger deploymnt
[19:59] * sjustlaptop (~sam@2607:f298:a:607:d841:5658:1f83:1de) Quit (Ping timeout: 480 seconds)
[20:02] * markbby (~Adium@168.94.245.4) has joined #ceph
[20:03] * andreask (~andreask@h081217135028.dyn.cm.kabsi.at) has joined #ceph
[20:03] * ChanServ sets mode +v andreask
[20:04] * andreask (~andreask@h081217135028.dyn.cm.kabsi.at) has left #ceph
[20:12] * nhm (~nhm@184-97-187-196.mpls.qwest.net) has joined #ceph
[20:12] * ChanServ sets mode +o nhm
[20:12] * markbby (~Adium@168.94.245.4) Quit (Quit: Leaving.)
[20:18] * houkouonchi-home (~linux@pool-108-47-126-200.lsanca.fios.verizon.net) has joined #ceph
[20:22] * lx0 (~aoliva@lxo.user.oftc.net) Quit (Ping timeout: 480 seconds)
[20:28] * lx0 (~aoliva@lxo.user.oftc.net) has joined #ceph
[20:33] * portante (~portante@nat-pool-bos-t.redhat.com) has joined #ceph
[20:41] * bandrus (~Adium@cpe-76-95-217-129.socal.res.rr.com) Quit (Quit: Leaving.)
[20:44] * rudolfsteiner (~federicon@200.68.116.185) has joined #ceph
[20:45] * ShaunR (~ShaunR@staff.ndchost.com) Quit (Read error: Operation timed out)
[20:47] * lx0 (~aoliva@lxo.user.oftc.net) Quit (Remote host closed the connection)
[20:49] * lx0 (~aoliva@lxo.user.oftc.net) has joined #ceph
[20:50] * alram (~alram@38.122.20.226) has joined #ceph
[20:51] * bandrus (~Adium@cpe-76-95-217-129.socal.res.rr.com) has joined #ceph
[21:09] * sleinen (~Adium@77-58-245-10.dclient.hispeed.ch) has joined #ceph
[21:12] <cmdrk> any reason why the rados bench provides stddev for writes but not reads?
[21:12] * bandrus (~Adium@cpe-76-95-217-129.socal.res.rr.com) Quit (Quit: Leaving.)
[21:13] * lx0 (~aoliva@lxo.user.oftc.net) Quit (Ping timeout: 480 seconds)
[21:16] * sleinen1 (~Adium@2001:620:0:26:f07f:787d:69ab:941b) Quit (Ping timeout: 480 seconds)
[21:16] * sleinen1 (~Adium@2001:620:0:26:d89c:ea4d:5435:22a0) has joined #ceph
[21:17] <nhm> cmdrk: probably just an oversight.
[21:18] <cmdrk> nhm: figured :)
[21:18] <dmick> write performance is what people tend to focus on, probably
[21:18] <cmdrk> there isnt a way to get the rados bench to write N objects rather than run for N seconds is there?
[21:18] <nhm> cmdrk: not currently. :/
[21:19] <cmdrk> i figured it might be a bit trickier to implement that :)
[21:19] <nhm> cmdrk: we'd happily take patches! ;)
[21:20] <cmdrk> hehe. maybe when my copious benchmarking is done
[21:20] * sagelap (~sage@2600:1010:b01c:9cea:8902:c697:3fb4:543d) Quit (Read error: Connection reset by peer)
[21:21] * sleinen (~Adium@77-58-245-10.dclient.hispeed.ch) Quit (Ping timeout: 480 seconds)
[21:21] * lx0 (~aoliva@lxo.user.oftc.net) has joined #ceph
[21:26] * sprachgenerator (~sprachgen@130.202.135.201) Quit (Quit: sprachgenerator)
[21:27] * sprachgenerator (~sprachgen@130.202.135.201) has joined #ceph
[21:28] * nwat (~nwat@c-50-131-197-174.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[21:29] * glzhao (~glzhao@118.195.65.67) Quit (Quit: leaving)
[21:30] <nagyz> so what's the verdict on using SSDs for journals with lots of disks?
[21:30] <nagyz> say 8/machine with 6 machines?
[21:30] <nagyz> I guess ideally I want to have 2-3 osds per SSD
[21:30] <nagyz> but I figure with lots of disks it can sorta balance out the scale
[21:33] <cmdrk> i have about 50 disks in one machine with 2 SSDs and it most certainly isn't enough :)
[21:35] <cmdrk> id guess 3-4 OSDs per SSD
[21:35] <cmdrk> depends on your SSD write performance too..
[21:36] <xarses> nagyz: see http://comments.gmane.org/gmane.comp.file-systems.ceph.user/4267 and http://www.hastexo.com/resources/hints-and-kinks/solid-state-drives-and-ceph-osd-journals
[21:38] <xarses> the rule would be definable as 1) dont share ssd journals or 2) journals per ssd = roundup(ssd_write_bw / spinner_write_bw )
[21:40] * wschulze (~wschulze@50.0.113.66) Quit (Quit: Leaving.)
[21:41] * sagelap (~sage@2600:1010:b01c:9cea:8902:c697:3fb4:543d) has joined #ceph
[21:44] <dmsimard1> I'm doing a lot of tests around this subject too - some SSDs have terrible write performance.. ex: Intel S3500 (poor write and random write) versus Intel 520 (great performance)
[21:44] * dmsimard1 is now known as dmsimard
[21:45] <dmsimard> For my particular use case, it looks like I might end up doing a 3U configuration with 16 drives in pairs of RAID-0's (so 8 OSD) and journals on the OSD themselves
[21:45] <dmsimard> I can't seem to find the right balance of spinners to OSD in the density and format that I want
[21:45] <dmsimard> (and price is of course a factor too)
[21:47] <dmsimard> There's some factors you have to take into account too - the amount of writes, your network bandwidth — your singular OSD performance might not be the bottleneck
[21:48] * sleinen (~Adium@77-58-245-10.dclient.hispeed.ch) has joined #ceph
[21:48] <nagyz> yeah, the problem is, I don't have that many SSDs for now
[21:50] * nwat (~nwat@c-50-131-197-174.hsd1.ca.comcast.net) has joined #ceph
[21:54] * sleinen1 (~Adium@2001:620:0:26:d89c:ea4d:5435:22a0) Quit (Ping timeout: 480 seconds)
[21:57] * KindOne (~KindOne@0001a7db.user.oftc.net) Quit (Read error: Connection reset by peer)
[21:57] * ircolle (~Adium@50.0.113.66) has joined #ceph
[22:02] * nwat (~nwat@c-50-131-197-174.hsd1.ca.comcast.net) Quit (Read error: Operation timed out)
[22:05] * KindOne (~KindOne@0001a7db.user.oftc.net) has joined #ceph
[22:07] * sleinen1 (~Adium@2001:620:0:25:e9a6:740a:d198:4822) has joined #ceph
[22:12] * sleinen (~Adium@77-58-245-10.dclient.hispeed.ch) Quit (Ping timeout: 480 seconds)
[22:17] * ircolle (~Adium@50.0.113.66) Quit (Quit: Leaving.)
[22:28] * sjustlaptop (~sam@38.122.20.226) has joined #ceph
[22:29] * ScOut3R (~scout3r@540099D1.dsl.pool.telekom.hu) Quit (Remote host closed the connection)
[22:30] * markbby (~Adium@168.94.245.4) has joined #ceph
[22:30] * WarrenUsui (~Warren@2607:f298:a:607:d6c:a17d:9df6:e298) has joined #ceph
[22:38] * aardvark (~Warren@2607:f298:a:607:956:fb3f:2383:3023) Quit (Ping timeout: 480 seconds)
[22:44] * sjustlaptop (~sam@38.122.20.226) Quit (Ping timeout: 480 seconds)
[22:51] * sjm (~sjm@dhcp-108-168-18-236.cable.user.start.ca) Quit (Quit: Leaving)
[22:51] * andreask (~andreask@h081217135028.dyn.cm.kabsi.at) has joined #ceph
[22:51] * ChanServ sets mode +v andreask
[22:51] * andreask (~andreask@h081217135028.dyn.cm.kabsi.at) has left #ceph
[22:53] * nwat (~nwat@c-50-131-197-174.hsd1.ca.comcast.net) has joined #ceph
[22:53] * grepory (~Adium@50-115-70-146.static-ip.telepacific.net) Quit (Quit: Leaving.)
[22:54] * wschulze (~wschulze@50.0.113.66) has joined #ceph
[22:55] * grepory (~Adium@50-115-70-146.static-ip.telepacific.net) has joined #ceph
[22:57] * rudolfsteiner (~federicon@200.68.116.185) Quit (Quit: rudolfsteiner)
[23:14] * gucki (~smuxi@HSI-KBW-109-192-187-143.hsi6.kabel-badenwuerttemberg.de) Quit (Remote host closed the connection)
[23:29] * sprachgenerator (~sprachgen@130.202.135.201) Quit (Quit: sprachgenerator)
[23:39] * yanzheng (~zhyan@101.84.49.228) has joined #ceph
[23:40] * markbby (~Adium@168.94.245.4) Quit (Quit: Leaving.)
[23:48] * yanzheng (~zhyan@101.84.49.228) Quit (Ping timeout: 480 seconds)
[23:54] * dmsimard (~Adium@108.163.152.2) Quit (Quit: Leaving.)
[23:54] * nwat (~nwat@c-50-131-197-174.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[23:58] * AfC (~andrew@2001:44b8:31cb:d400:2ad2:44ff:fe08:a4c) has joined #ceph

These logs were automatically created by CephLogBot on irc.oftc.net using the Java IRC LogBot.