#ceph IRC Log

Index

IRC Log for 2015-05-08

Timestamps are in GMT/BST.

[0:00] * osuka_ (~mps@7R2AAAKXA.tor-irc.dnsbl.oftc.net) Quit ()
[0:00] * SEBI1 (~Hideous@exit-01d.noisetor.net) has joined #ceph
[0:16] * yanzheng (~zhyan@171.216.95.141) has joined #ceph
[0:20] * Baker (~Baker@159.140.254.97) Quit (Remote host closed the connection)
[0:20] * c4tech (~c4tech@199.91.185.156) has joined #ceph
[0:22] <c4tech> Hi Team! I'm really hoping someone can help me with the best was to handle this problem. We currently have 3 openstack environments (alpha beta charlie). I'm trying to figure out the best way to connect them to radosgw.
[0:23] <c4tech> Can I point them all to the same radosgw with the same region, zone?
[0:24] <c4tech> Or should I setup a federated setup and use a different region?
[0:24] * fsimonce (~simon@host11-35-dynamic.32-79-r.retail.telecomitalia.it) Quit (Quit: Coyote finally caught me)
[0:25] * rotbeard (~redbeard@2a02:908:df10:d300:76f0:6dff:fe3b:994d) has joined #ceph
[0:28] * Marty (~ja3232@93-167-84-102-static.dk.customer.tdc.net) Quit (Remote host closed the connection)
[0:29] * cfreak200 (andi@p4FF3E9B0.dip0.t-ipconnect.de) Quit (Ping timeout: 480 seconds)
[0:30] * SEBI1 (~Hideous@789AAANIN.tor-irc.dnsbl.oftc.net) Quit ()
[0:30] * primechuck (~primechuc@host-95-2-129.infobunker.com) Quit (Remote host closed the connection)
[0:30] * Sun7zu (~ZombieTre@thoreau.gtor.org) has joined #ceph
[0:30] <dmlb2000> c4tech: are the three openstack environments using the same keystone?
[0:32] * cfreak200 (andi@p4FF3E72B.dip0.t-ipconnect.de) has joined #ceph
[0:33] * daniel2_ (~dshafer@0001b605.user.oftc.net) Quit (Ping timeout: 480 seconds)
[0:34] * yanzheng (~zhyan@171.216.95.141) Quit (Quit: This computer has gone to sleep)
[0:39] <c4tech> <dmlb2000> It's a different keystone. Thank you for your help!
[0:42] <dmlb2000> Then I'd suggest making one radosgw and you can only hook it up to one keystone...
[0:42] * yanzheng (~zhyan@171.216.95.141) has joined #ceph
[0:43] <dmlb2000> or make one radosgw and don't hook it up to keystone at all, and manage the accounts and authentication with radosgw-admin or something
[0:45] * cfreak200 (andi@p4FF3E72B.dip0.t-ipconnect.de) Quit (Ping timeout: 480 seconds)
[0:46] <c4tech> Ok Thanks!
[0:47] * c4tech (~c4tech@199.91.185.156) Quit ()
[0:48] * cfreak200 (andi@p4FF3E199.dip0.t-ipconnect.de) has joined #ceph
[0:53] <sage> any wheezy users in here?
[0:53] * pvh_sa_ (~pvh@105.210.15.225) Quit (Ping timeout: 480 seconds)
[0:55] <Karcaw> on the rados level we just dumped the whole pool to see if things were borked at a lower level, and that worked.
[0:56] <Karcaw> doh..
[0:56] <Karcaw> sage, did you see my question about rbd export hanging?
[0:58] <Karcaw> looking at debug on the client side, it seems to setup some threads to recieve the data chunks, but they never seems to complete.
[0:58] <Kingrat> sage, i am running proxmox nodes with hammer, it is based on wheezy
[0:59] * SpamapS (~clint@xencbyrum2.srihosting.com) has joined #ceph
[0:59] <Kingrat> brad_mssw whom comes around from time to time is as well, but i dont know if he is running hammer, giant, or firefly
[1:00] * Sun7zu (~ZombieTre@53IAAAKAE.tor-irc.dnsbl.oftc.net) Quit ()
[1:00] * utugi______ (~luigiman@chomsky.torservers.net) has joined #ceph
[1:00] <sage> Kingrat: have you tried ceph-deploy install recently? on my test vm i'm gettin ga ssl cert error.. i think because of the new git.ceph.com, but am surprised that we haven't heard complaints about it
[1:00] <sage> yeah
[1:01] <Kingrat> no, i have not
[1:02] <Kingrat> last time i installed was firefly, i have just upgraded since then
[1:03] <Kingrat> deb http://ceph.com/debian-hammer wheezy main
[1:04] <Kingrat> thats the repo i am currently using, let me see if there is anything i can do without blowing away my ceph install on this host to trigger the problem
[1:06] <Kingrat> actually nevermind, proxmox has its own deployment tool, sorry probably wont be able to help
[1:06] <sage> no worries. if you run into problems later, let us know!
[1:09] * alram (~alram@206.169.83.146) Quit (Ping timeout: 480 seconds)
[1:09] * Elwell (~elwell@58-7-85-157.dyn.iinet.net.au) has joined #ceph
[1:10] * reed (~reed@cpe-45-48-32-93.socal.res.rr.com) Quit (Ping timeout: 480 seconds)
[1:11] * Elwell_ (~elwell@106-68-57-202.dyn.iinet.net.au) Quit (Ping timeout: 480 seconds)
[1:11] * yanzheng (~zhyan@171.216.95.141) Quit (Quit: This computer has gone to sleep)
[1:11] * CheKoLyN (~saguilar@bender.parc.xerox.com) Quit (Remote host closed the connection)
[1:12] * rendar (~I@host237-179-dynamic.1-87-r.retail.telecomitalia.it) Quit ()
[1:14] * puffy (~puffy@50.185.218.255) Quit (Quit: Leaving.)
[1:16] <Anticimex> dmlb2000: i don't, i just know it exists :)
[1:16] <Anticimex> its stored as a rados object somewhere
[1:16] <Kingrat> sage, proxmox has an updated pveceph (their deployment tool) in their changelog they noted that they are now using git.ceph.com for the key download url
[1:16] <Kingrat> so you are probably right
[1:17] <Kingrat> the update went out april 27
[1:17] * dalgaaf (uid15138@id-15138.charlton.irccloud.com) Quit (Quit: Connection closed for inactivity)
[1:18] * lxo (~aoliva@lxo.user.oftc.net) Quit (Quit: later)
[1:19] * nsoffer (~nsoffer@bzq-79-179-80-180.red.bezeqint.net) Quit (Ping timeout: 480 seconds)
[1:19] * MentalRay (~MRay@MTRLPQ42-1176054809.sdsl.bell.ca) Quit (Ping timeout: 480 seconds)
[1:27] * fsckstix (~stevpem@1.136.97.50) has joined #ceph
[1:30] * utugi______ (~luigiman@5NZAACENB.tor-irc.dnsbl.oftc.net) Quit ()
[1:34] * Atomizer (~Ralth@72.52.91.30) has joined #ceph
[1:36] * mwilcox (~mwilcox@116.251.192.71) has joined #ceph
[1:40] * ebeerman (~ebeerman@64.202.160.233) has joined #ceph
[1:41] * nsoffer (~nsoffer@bzq-79-179-80-180.red.bezeqint.net) has joined #ceph
[1:41] * oms101 (~oms101@p20030057EA04C500EEF4BBFFFE0F7062.dip0.t-ipconnect.de) Quit (Ping timeout: 480 seconds)
[1:42] * ChrisNBlum (~ChrisNBlu@178.255.153.117) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[1:44] * sjm (~sjm@pool-173-70-76-86.nwrknj.fios.verizon.net) has joined #ceph
[1:44] * black951 (~black951@108-90-48-13.lightspeed.sndgca.sbcglobal.net) has joined #ceph
[1:45] * black951 (~black951@108-90-48-13.lightspeed.sndgca.sbcglobal.net) has left #ceph
[1:48] * fsckstix (~stevpem@1.136.97.50) Quit (Ping timeout: 480 seconds)
[1:50] * oms101 (~oms101@p20030057EA03E600EEF4BBFFFE0F7062.dip0.t-ipconnect.de) has joined #ceph
[1:53] * LeaChim (~LeaChim@host86-171-90-60.range86-171.btcentralplus.com) Quit (Ping timeout: 480 seconds)
[1:54] * brutuscat (~brutuscat@105.34.133.37.dynamic.jazztel.es) Quit (Remote host closed the connection)
[1:59] * ebeerman (~ebeerman@64.202.160.233) Quit (Quit: Leaving...)
[2:00] * yanzheng (~zhyan@171.216.95.141) has joined #ceph
[2:04] * Atomizer (~Ralth@789AAANLY.tor-irc.dnsbl.oftc.net) Quit ()
[2:04] * chutwig (~textual@pool-173-63-230-184.nwrknj.fios.verizon.net) has joined #ceph
[2:06] * yanzheng (~zhyan@171.216.95.141) Quit (Quit: This computer has gone to sleep)
[2:06] * OutOfNoWhere (~rpb@199.68.195.102) has joined #ceph
[2:09] * jdillaman (~jdillaman@pool-173-66-110-250.washdc.fios.verizon.net) has joined #ceph
[2:13] * fsckstix (~stevpem@202.161.23.74) has joined #ceph
[2:15] * lxo (~aoliva@lxo.user.oftc.net) has joined #ceph
[2:16] * xarses (~andreww@12.164.168.117) Quit (Ping timeout: 480 seconds)
[2:17] * cyberhide (~oftc-webi@c-73-189-169-128.hsd1.ca.comcast.net) Quit (Remote host closed the connection)
[2:18] * hellertime (~Adium@pool-173-48-154-80.bstnma.fios.verizon.net) has joined #ceph
[2:33] * jdillaman (~jdillaman@pool-173-66-110-250.washdc.fios.verizon.net) Quit (Quit: jdillaman)
[2:34] * Fapiko (~delcake@TerokNor.tor-exit.network) has joined #ceph
[2:42] * lucas1 (~Thunderbi@218.76.52.64) has joined #ceph
[2:44] * MentalRay (~MRay@107.171.161.165) has joined #ceph
[2:59] * xarses (~andreww@c-76-126-112-92.hsd1.ca.comcast.net) has joined #ceph
[2:59] * JV (~chatzilla@204.14.239.107) Quit (Ping timeout: 480 seconds)
[3:04] * Fapiko (~delcake@7R2AAAK7J.tor-irc.dnsbl.oftc.net) Quit ()
[3:04] * rf`1 (~x303@176.10.99.201) has joined #ceph
[3:07] * joshd1 (~jdurgin@68-119-140-18.dhcp.ahvl.nc.charter.com) Quit (Quit: Leaving.)
[3:10] * yanzheng (~zhyan@171.216.95.141) has joined #ceph
[3:10] * lxo (~aoliva@lxo.user.oftc.net) Quit (Ping timeout: 480 seconds)
[3:19] * lxo (~aoliva@lxo.user.oftc.net) has joined #ceph
[3:21] * PaulC (~paul@122-59-153-185.jetstream.xtra.co.nz) has joined #ceph
[3:21] * xarses (~andreww@c-76-126-112-92.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[3:21] * kefu (~kefu@114.86.209.84) has joined #ceph
[3:27] * hellertime (~Adium@pool-173-48-154-80.bstnma.fios.verizon.net) Quit (Quit: Leaving.)
[3:28] * lx0 (~aoliva@lxo.user.oftc.net) has joined #ceph
[3:29] * brutuscat (~brutuscat@105.34.133.37.dynamic.jazztel.es) has joined #ceph
[3:31] * bandrus (~brian@36.sub-70-211-68.myvzw.com) has joined #ceph
[3:31] * xarses (~andreww@c-73-202-191-48.hsd1.ca.comcast.net) has joined #ceph
[3:33] * lxo (~aoliva@lxo.user.oftc.net) Quit (Ping timeout: 480 seconds)
[3:34] * rf`1 (~x303@0SGAAAJ24.tor-irc.dnsbl.oftc.net) Quit ()
[3:34] * Atomizer (~isaxi@ncc-1701-a.tor-exit.network) has joined #ceph
[3:39] * brutuscat (~brutuscat@105.34.133.37.dynamic.jazztel.es) Quit (Ping timeout: 480 seconds)
[3:48] * primechuck (~primechuc@173-17-128-216.client.mchsi.com) has joined #ceph
[3:54] * zhaochao (~zhaochao@124.202.190.2) has joined #ceph
[3:59] * shohn1 (~shohn@dslb-088-075-232-206.088.075.pools.vodafone-ip.de) has joined #ceph
[4:00] * shohn (~shohn@dslb-088-075-233-102.088.075.pools.vodafone-ip.de) Quit (Ping timeout: 480 seconds)
[4:01] * aj__ (~aj@vpn03.freefii.com) has joined #ceph
[4:04] * Atomizer (~isaxi@53IAAAKHD.tor-irc.dnsbl.oftc.net) Quit ()
[4:04] * xarses (~andreww@c-73-202-191-48.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[4:04] * Spessu (~PuyoDead@176.10.99.205) has joined #ceph
[4:08] * derjohn_mobi (~aj@vpn09.freefii.com) Quit (Ping timeout: 480 seconds)
[4:14] * xarses (~andreww@c-73-202-191-48.hsd1.ca.comcast.net) has joined #ceph
[4:17] * MentalRay (~MRay@107.171.161.165) Quit (Quit: This computer has gone to sleep)
[4:31] * nsoffer (~nsoffer@bzq-79-179-80-180.red.bezeqint.net) Quit (Ping timeout: 480 seconds)
[4:34] * Spessu (~PuyoDead@0SGAAAJ46.tor-irc.dnsbl.oftc.net) Quit ()
[4:34] * Sun7zu (~Heliwr@ncc-1701-a.tor-exit.network) has joined #ceph
[4:34] * JV (~chatzilla@static-50-53-42-60.bvtn.or.frontiernet.net) has joined #ceph
[4:36] * JV_ (~chatzilla@204.14.239.107) has joined #ceph
[4:36] * angdraug (~angdraug@12.164.168.117) Quit (Ping timeout: 480 seconds)
[4:43] * JV (~chatzilla@static-50-53-42-60.bvtn.or.frontiernet.net) Quit (Ping timeout: 480 seconds)
[4:43] * xarses (~andreww@c-73-202-191-48.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[4:52] * xarses (~andreww@c-73-202-191-48.hsd1.ca.comcast.net) has joined #ceph
[4:55] * JV_ (~chatzilla@204.14.239.107) Quit (Ping timeout: 480 seconds)
[5:01] * Vacuum_ (~vovo@88.130.219.225) has joined #ceph
[5:04] * Sun7zu (~Heliwr@53IAAAKJN.tor-irc.dnsbl.oftc.net) Quit ()
[5:04] * KUSmurf (~ItsCrimin@95.130.15.96) has joined #ceph
[5:04] * MentalRay (~MRay@107.171.161.165) has joined #ceph
[5:08] * bandrus (~brian@36.sub-70-211-68.myvzw.com) Quit (Quit: Leaving.)
[5:08] * bandrus (~brian@36.sub-70-211-68.myvzw.com) has joined #ceph
[5:08] * Vacuum__ (~vovo@i59F7969E.versanet.de) Quit (Ping timeout: 480 seconds)
[5:13] * dynamicudpate (~overonthe@199.68.193.54) has joined #ceph
[5:13] * overclk (~overclk@121.244.87.117) has joined #ceph
[5:13] * snerd (~motk@2600:3c00::f03c:91ff:fedb:2295) has joined #ceph
[5:14] <snerd> hello - I have a radosgw instance where I've created two identical users
[5:14] <snerd> one auth's fine, the other 403s
[5:14] <snerd> any hints?
[5:15] * xarses (~andreww@c-73-202-191-48.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[5:17] * chutwig (~textual@pool-173-63-230-184.nwrknj.fios.verizon.net) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[5:18] * OnTheRock (~overonthe@199.68.193.62) Quit (Ping timeout: 480 seconds)
[5:28] * jclm (~jclm@ip24-253-45-236.lv.lv.cox.net) has joined #ceph
[5:32] * MentalRay (~MRay@107.171.161.165) Quit (Quit: This computer has gone to sleep)
[5:34] * KUSmurf (~ItsCrimin@5NZAACEQA.tor-irc.dnsbl.oftc.net) Quit ()
[5:34] * allenmelon (~Deiz@104.167.118.51) has joined #ceph
[5:37] * xarses (~andreww@c-73-202-191-48.hsd1.ca.comcast.net) has joined #ceph
[5:40] * aj__ (~aj@vpn03.freefii.com) Quit (Read error: Connection reset by peer)
[5:43] * debian112 (~bcolbert@24.126.201.64) Quit (Quit: Leaving.)
[5:51] * rdas (~rdas@122.168.75.126) has joined #ceph
[6:00] * Vacuum__ (~vovo@i59F79376.versanet.de) has joined #ceph
[6:00] * kanagaraj (~kanagaraj@121.244.87.117) has joined #ceph
[6:04] * MentalRay (~MRay@107.171.161.165) has joined #ceph
[6:04] * allenmelon (~Deiz@789AAANTC.tor-irc.dnsbl.oftc.net) Quit ()
[6:07] * Vacuum_ (~vovo@88.130.219.225) Quit (Ping timeout: 480 seconds)
[6:07] * JV (~chatzilla@204.14.239.17) has joined #ceph
[6:13] * vbellur (~vijay@122.167.250.154) Quit (Ping timeout: 480 seconds)
[6:17] * jeevan_ullas (~Deependra@114.143.35.188) has joined #ceph
[6:19] * pvh_sa_ (~pvh@105.210.15.225) has joined #ceph
[6:26] * ngoswami (~ngoswami@1.186.40.91) has joined #ceph
[6:26] * treenerd (~treenerd@cpe90-146-100-181.liwest.at) has joined #ceph
[6:29] * primechuck (~primechuc@173-17-128-216.client.mchsi.com) Quit (Remote host closed the connection)
[6:29] * primechuck (~primechuc@173-17-128-216.client.mchsi.com) has joined #ceph
[6:30] * jclm (~jclm@ip24-253-45-236.lv.lv.cox.net) Quit (Quit: Leaving.)
[6:32] * kefu (~kefu@114.86.209.84) Quit (Max SendQ exceeded)
[6:32] * kefu (~kefu@114.86.209.84) has joined #ceph
[6:33] * pvh_sa_ (~pvh@105.210.15.225) Quit (Ping timeout: 480 seconds)
[6:34] * Da_Pineapple (~Catsceo@188.165.59.43) has joined #ceph
[6:36] * ngoswami (~ngoswami@1.186.40.91) Quit (Quit: Leaving)
[6:37] * primechuck (~primechuc@173-17-128-216.client.mchsi.com) Quit (Ping timeout: 480 seconds)
[6:43] * pvh_sa_ (~pvh@105.210.15.225) has joined #ceph
[6:48] * MentalRay (~MRay@107.171.161.165) Quit (Quit: This computer has gone to sleep)
[6:51] * bearkitten (~bearkitte@cpe-76-172-86-115.socal.res.rr.com) Quit (Quit: WeeChat 1.1.1)
[6:53] * hasues (~hazuez@108-236-232-243.lightspeed.knvltn.sbcglobal.net) has joined #ceph
[6:53] * hasues (~hazuez@108-236-232-243.lightspeed.knvltn.sbcglobal.net) has left #ceph
[6:56] * bearkitten (~bearkitte@cpe-76-172-86-115.socal.res.rr.com) has joined #ceph
[6:56] * kefu is now known as kefu|afk
[6:59] * karnan (~karnan@106.51.134.150) has joined #ceph
[7:04] * Da_Pineapple (~Catsceo@7R2AAALKU.tor-irc.dnsbl.oftc.net) Quit ()
[7:04] * aldiyen (~theghost9@nx-01.tor-exit.network) has joined #ceph
[7:05] * cholcombe (~chris@pool-108-42-124-94.snfcca.fios.verizon.net) Quit (Ping timeout: 480 seconds)
[7:10] * pvh_sa_ (~pvh@105.210.15.225) Quit (Ping timeout: 480 seconds)
[7:11] * JV (~chatzilla@204.14.239.17) Quit (Ping timeout: 480 seconds)
[7:22] * zaitcev (~zaitcev@2001:558:6001:10:61d7:f51f:def8:4b0f) Quit (Quit: Bye)
[7:31] * vbellur (~vijay@121.244.87.117) has joined #ceph
[7:33] * bkopilov (~bkopilov@bzq-79-177-54-17.red.bezeqint.net) Quit (Ping timeout: 480 seconds)
[7:34] * aldiyen (~theghost9@7R2AAALMK.tor-irc.dnsbl.oftc.net) Quit ()
[7:34] * macjack (~macjack@122.146.93.152) has joined #ceph
[7:38] * fsckstix (~stevpem@202.161.23.74) Quit (Ping timeout: 480 seconds)
[7:40] * kefu|afk (~kefu@114.86.209.84) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[7:41] * pvh_sa_ (~pvh@105.210.15.225) has joined #ceph
[7:45] * bkopilov (~bkopilov@bzq-79-177-54-17.red.bezeqint.net) has joined #ceph
[7:53] * evl (~chatzilla@139.216.138.39) has joined #ceph
[7:56] * Hemanth (~Hemanth@121.244.87.117) has joined #ceph
[7:56] * shylesh (~shylesh@121.244.87.124) has joined #ceph
[7:59] * kawa2014 (~kawa@212.77.3.87) has joined #ceph
[8:01] * Concubidated (~Adium@71.21.5.251) Quit (Quit: Leaving.)
[8:07] * cok (~chk@2a02:2350:18:1010:34b7:cea9:39f8:620f) has joined #ceph
[8:13] * pvh_sa_ (~pvh@105.210.15.225) Quit (Ping timeout: 480 seconds)
[8:15] * bandrus (~brian@36.sub-70-211-68.myvzw.com) Quit (Ping timeout: 480 seconds)
[8:16] * oro (~oro@80-219-254-208.dclient.hispeed.ch) has joined #ceph
[8:18] * T1w (~jens@node3.survey-it.dk) has joined #ceph
[8:19] * shang (~ShangWu@175.41.48.77) has joined #ceph
[8:20] * vbellur (~vijay@121.244.87.117) Quit (Ping timeout: 480 seconds)
[8:23] * DV (~veillard@2001:41d0:1:d478::1) Quit (Ping timeout: 480 seconds)
[8:26] * bandrus (~brian@179.sub-70-214-32.myvzw.com) has joined #ceph
[8:29] * Sysadmin88 (~IceChat77@054527d3.skybroadband.com) Quit (Quit: Not that there is anything wrong with that)
[8:33] * DV (~veillard@2001:41d0:a:f29f::1) has joined #ceph
[8:36] * vbellur (~vijay@121.244.87.124) has joined #ceph
[8:38] * oro (~oro@80-219-254-208.dclient.hispeed.ch) Quit (Ping timeout: 480 seconds)
[8:40] * kefu (~kefu@114.86.209.84) has joined #ceph
[8:49] * bkopilov (~bkopilov@bzq-79-177-54-17.red.bezeqint.net) Quit (Ping timeout: 480 seconds)
[8:51] * derjohn_mob (~aj@148.251.44.141) has joined #ceph
[8:59] * bandrus (~brian@179.sub-70-214-32.myvzw.com) Quit (Ping timeout: 480 seconds)
[9:04] * b0e (~aledermue@213.95.25.82) has joined #ceph
[9:04] * Plesioth (~ricin@tor-exit-4.all.de) has joined #ceph
[9:10] * zhaochao_ (~zhaochao@123.125.35.150) has joined #ceph
[9:11] * bandrus (~brian@59.sub-70-211-66.myvzw.com) has joined #ceph
[9:13] * sleinen1 (~Adium@2001:620:0:82::103) Quit (Ping timeout: 480 seconds)
[9:15] * zhaochao (~zhaochao@124.202.190.2) Quit (Ping timeout: 480 seconds)
[9:15] * zhaochao_ is now known as zhaochao
[9:16] * evl (~chatzilla@139.216.138.39) Quit (Quit: ChatZilla 0.9.91.1 [Firefox 37.0.2/20150416103922])
[9:16] * c3s4r (~christian@mintzer.imp.fu-berlin.de) Quit (Remote host closed the connection)
[9:22] * analbeard (~shw@support.memset.com) has joined #ceph
[9:23] * treenerd (~treenerd@cpe90-146-100-181.liwest.at) Quit (Quit: Verlassend)
[9:24] * pvh_sa_ (~pvh@41.164.8.114) has joined #ceph
[9:26] * rotbeard (~redbeard@2a02:908:df10:d300:76f0:6dff:fe3b:994d) Quit (Quit: Verlassend)
[9:26] * Plesioth (~ricin@789AAAN09.tor-irc.dnsbl.oftc.net) Quit (Remote host closed the connection)
[9:28] * cok (~chk@2a02:2350:18:1010:34b7:cea9:39f8:620f) Quit (Quit: Leaving.)
[9:30] * i_m (~ivan.miro@pool-109-191-92-175.is74.ru) has joined #ceph
[9:31] * Be-El (~quassel@fb08-bcf-pc01.computational.bio.uni-giessen.de) has joined #ceph
[9:31] * TMM (~hp@178-84-46-106.dynamic.upc.nl) Quit (Quit: Ex-Chat)
[9:32] <Be-El> hi
[9:38] * sleinen (~Adium@2001:620:0:2d:7ed1:c3ff:fedc:3223) has joined #ceph
[9:39] * Vacuum__ (~vovo@i59F79376.versanet.de) Quit (Quit: leaving)
[9:44] * dgurtner (~dgurtner@178.197.231.80) has joined #ceph
[9:47] * fsimonce (~simon@host11-35-dynamic.32-79-r.retail.telecomitalia.it) has joined #ceph
[9:48] * derjohn_mob (~aj@148.251.44.141) Quit (Ping timeout: 480 seconds)
[9:50] * angdraug (~angdraug@63.142.161.2) has joined #ceph
[9:51] * angdraug (~angdraug@63.142.161.2) Quit ()
[9:52] * vbellur (~vijay@121.244.87.124) Quit (Ping timeout: 480 seconds)
[9:53] * jeroenvh (~jeroen@37.74.194.90) Quit (Ping timeout: 480 seconds)
[9:54] * zhaochao_ (~zhaochao@125.39.8.238) has joined #ceph
[9:55] * vovo (~vovo@i59F79376.versanet.de) has joined #ceph
[9:55] * vovo is now known as Vacuum_
[9:56] * jeroenvh (~jeroen@37.74.194.90) has joined #ceph
[9:56] * smerz (~ircircirc@37.74.194.90) has joined #ceph
[9:56] * Eric (~notarima@tor-exit2-readme.puckey.org) has joined #ceph
[9:57] <anorak> hi
[9:57] * zhaochao (~zhaochao@123.125.35.150) Quit (Ping timeout: 480 seconds)
[9:57] * zhaochao_ is now known as zhaochao
[10:01] * sjm (~sjm@pool-173-70-76-86.nwrknj.fios.verizon.net) Quit (Ping timeout: 480 seconds)
[10:01] <anorak> I expanded my ceph cluster using ceph-deploy but the ceph.conf in all my nodes does not reflect the current state of my cluster (5 mons,20 osds etc). I tried using "ceph-deploy config push" but that did not work as well. any hints?
[10:02] * vbellur (~vijay@121.244.87.117) has joined #ceph
[10:03] * rwheeler (~rwheeler@5.29.243.114) Quit (Quit: Leaving)
[10:05] * dalgaaf (uid15138@id-15138.charlton.irccloud.com) has joined #ceph
[10:07] * DV__ (~veillard@2001:41d0:1:d478::1) has joined #ceph
[10:08] * pdrakeweb (~pdrakeweb@cpe-65-185-74-239.neo.res.rr.com) Quit (Ping timeout: 480 seconds)
[10:12] * TMM (~hp@sams-office-nat.tomtomgroup.com) has joined #ceph
[10:13] * cok (~chk@nat-cph1-sys.net.one.com) has joined #ceph
[10:14] * DV (~veillard@2001:41d0:a:f29f::1) Quit (Ping timeout: 480 seconds)
[10:14] * smerz (~ircircirc@37.74.194.90) Quit (Ping timeout: 480 seconds)
[10:15] * derjohn_mob (~aj@fw.gkh-setu.de) has joined #ceph
[10:24] * c_sa (~christian@mintzer.imp.fu-berlin.de) has joined #ceph
[10:25] * smerz (~ircircirc@37.74.194.90) has joined #ceph
[10:26] * brutuscat (~brutuscat@74.Red-88-8-87.dynamicIP.rima-tde.net) has joined #ceph
[10:26] * Eric (~notarima@7R2AAALWV.tor-irc.dnsbl.oftc.net) Quit ()
[10:26] * lmg (~Xerati@TerokNor.tor-exit.network) has joined #ceph
[10:27] * shang (~ShangWu@175.41.48.77) Quit (Remote host closed the connection)
[10:27] * char|on (~ls@dslb-178-009-182-130.178.009.pools.vodafone-ip.de) has joined #ceph
[10:28] * cok (~chk@nat-cph1-sys.net.one.com) Quit (Quit: Leaving.)
[10:30] * rotbeard (~redbeard@x5f74e5dc.dyn.telefonica.de) has joined #ceph
[10:36] * oro (~oro@2001:620:20:16:2d63:22e0:52c0:e2e3) has joined #ceph
[10:51] * bkopilov (~bkopilov@bzq-79-183-126-150.red.bezeqint.net) has joined #ceph
[10:56] * hellertime (~Adium@a72-246-185-10.deploy.akamaitechnologies.com) has joined #ceph
[10:56] * lmg (~Xerati@789AAAN5E.tor-irc.dnsbl.oftc.net) Quit ()
[10:56] * smf681 (~airsoftgl@tor-exit2-readme.puckey.org) has joined #ceph
[10:57] * Hemanth (~Hemanth@121.244.87.117) Quit (Quit: Leaving)
[10:57] * analbeard (~shw@support.memset.com) Quit (Quit: Leaving.)
[10:57] * Hemanth (~Hemanth@121.244.87.117) has joined #ceph
[10:58] * analbeard (~shw@support.memset.com) has joined #ceph
[11:01] * sleinen1 (~Adium@2001:620:0:82::107) has joined #ceph
[11:02] <char|on> hi, i ran into an issue with an erasure encoded pool with lrc plugin. i created two pools one replicated as hot-storage and one erasure pool as cold storage.
[11:03] <char|on> then i started installing a vm an rebooted one node during install. it's a 14 node test cluster with five mons on the hosts
[11:04] <char|on> after the reboot i got " osd.72 10.10.10.106:6816/5560 10 : cluster [WRN] slow request 480.005368 seconds old, received at 2015-05-08 10:54:06.974200: osd_op(client.14520543.0:29979 rbd_data.daadec2ae8944a.0000000000003a7b [set-alloc-hint object_size 4194304 write_size 4194304,write 1314816~45056] 38.56dd815b ack+ondisk+write+known_if_redirected e11008) currently reached_pg"
[11:05] <char|on> so i guess i could just stop the osd service and wait, but i think it should self heal when i just reboot one node?
[11:05] <char|on> ceph health detail shows "1 ops are blocked > 1048.58 sec on osd.72"
[11:05] <char|on> but i did not reboot the node with osd.72 on it
[11:06] * Nacer (~Nacer@2001:41d0:fe82:7200:cca4:b00b:e663:5ea2) has joined #ceph
[11:06] <char|on> ceph osd map telles me that it would store the object on osd.72 and osd.1 (on the rebooted node)
[11:08] * sleinen (~Adium@2001:620:0:2d:7ed1:c3ff:fedc:3223) Quit (Ping timeout: 480 seconds)
[11:09] * rendar (~I@host195-179-dynamic.10-87-r.retail.telecomitalia.it) has joined #ceph
[11:17] * martineg (~martin@shell01.copyleft.no) has joined #ceph
[11:20] * analbeard (~shw@support.memset.com) Quit (Ping timeout: 480 seconds)
[11:22] * kapsel (~k@psel.dk) has joined #ceph
[11:22] * fridim_ (~fridim@56-198-190-109.dsl.ovh.fr) has joined #ceph
[11:23] * cok (~chk@nat-cph1-sys.net.one.com) has joined #ceph
[11:24] * ChrisNBlum (~ChrisNBlu@178.255.153.117) has joined #ceph
[11:24] * analbeard (~shw@5.153.255.226) has joined #ceph
[11:25] * Vacuum__ (~vovo@i59F7A3B9.versanet.de) has joined #ceph
[11:26] * smf681 (~airsoftgl@5NZAACETB.tor-irc.dnsbl.oftc.net) Quit ()
[11:31] * ChrisNBl_ (~ChrisNBlu@dhcp-ip-230.dorf.rwth-aachen.de) has joined #ceph
[11:31] * Vacuum_ (~vovo@i59F79376.versanet.de) Quit (Ping timeout: 480 seconds)
[11:36] * nsoffer (~nsoffer@bzq-79-179-80-180.red.bezeqint.net) has joined #ceph
[11:38] * ChrisNBlum (~ChrisNBlu@178.255.153.117) Quit (Ping timeout: 480 seconds)
[11:44] * cok (~chk@nat-cph1-sys.net.one.com) Quit (Quit: Leaving.)
[11:49] * renzhi (~renzhi@116.226.63.25) Quit (Quit: Leaving)
[11:54] * cyberhide (~oftc-webi@c-73-189-169-128.hsd1.ca.comcast.net) has joined #ceph
[11:56] <cyberhide> helo everyone. I am having a strange requests blocked issue with my ceph cluster. It is showing some frequent requests blocked in the health status. Upon investigation, it appears that connections between OSDs are sometimes dying, and hanging with the message "initiating reconnect"
[11:56] <cyberhide> i am running 0.87.2
[11:56] * Lunk2 (~RaidSoft@nx-74205.tor-exit.network) has joined #ceph
[11:57] <cyberhide> my networking looks healthy, and I dont see dropped packets on the interfaces. Cpu, memory, disk, and network are all really low (5-10%)
[11:58] * bandrus (~brian@59.sub-70-211-66.myvzw.com) Quit (Quit: Leaving.)
[12:00] * vbellur (~vijay@121.244.87.117) Quit (Ping timeout: 480 seconds)
[12:03] <cyberhide> also seeing this "failed lossy con, dropping message"
[12:10] * ChrisNBlum (~ChrisNBlu@178.255.153.117) has joined #ceph
[12:12] * vbellur (~vijay@121.244.87.124) has joined #ceph
[12:14] * cok (~chk@2a02:2350:18:1010:ecc0:43f8:5bdb:ced4) has joined #ceph
[12:17] * ChrisNBl_ (~ChrisNBlu@dhcp-ip-230.dorf.rwth-aachen.de) Quit (Ping timeout: 480 seconds)
[12:26] * nsoffer (~nsoffer@bzq-79-179-80-180.red.bezeqint.net) Quit (Ping timeout: 480 seconds)
[12:26] * Lunk2 (~RaidSoft@789AAAN9A.tor-irc.dnsbl.oftc.net) Quit ()
[12:29] * lucas1 (~Thunderbi@218.76.52.64) Quit (Quit: lucas1)
[12:35] * nsoffer (~nsoffer@bzq-109-64-255-118.red.bezeqint.net) has joined #ceph
[12:36] * kefu (~kefu@114.86.209.84) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[12:49] * brutuscat (~brutuscat@74.Red-88-8-87.dynamicIP.rima-tde.net) Quit (Read error: Connection reset by peer)
[12:51] * sjm (~sjm@pool-173-70-76-86.nwrknj.fios.verizon.net) has joined #ceph
[12:52] * sjm (~sjm@pool-173-70-76-86.nwrknj.fios.verizon.net) Quit ()
[12:52] * sjm (~sjm@pool-173-70-76-86.nwrknj.fios.verizon.net) has joined #ceph
[12:53] * mwilcox (~mwilcox@116.251.192.71) Quit (Ping timeout: 480 seconds)
[12:54] * jdillaman (~jdillaman@pool-173-66-110-250.washdc.fios.verizon.net) has joined #ceph
[12:56] * TomyLobo (~VampiricP@7R2AAAL68.tor-irc.dnsbl.oftc.net) has joined #ceph
[12:58] * brutuscat (~brutuscat@74.Red-88-8-87.dynamicIP.rima-tde.net) has joined #ceph
[13:01] * ChrisNBl_ (~ChrisNBlu@dhcp-ip-150.dorf.rwth-aachen.de) has joined #ceph
[13:01] * ChrisNBlum (~ChrisNBlu@178.255.153.117) Quit (Read error: No route to host)
[13:02] * ChrisNBlum (~ChrisNBlu@178.255.153.117) has joined #ceph
[13:02] * topro (~prousa@host-62-245-142-50.customer.m-online.net) Quit (Quit: Konversation terminated!)
[13:06] * topro (~prousa@host-62-245-142-50.customer.m-online.net) has joined #ceph
[13:09] * ChrisNBl_ (~ChrisNBlu@dhcp-ip-150.dorf.rwth-aachen.de) Quit (Ping timeout: 480 seconds)
[13:10] * i_m (~ivan.miro@pool-109-191-92-175.is74.ru) Quit (Quit: Leaving.)
[13:12] * wicope (~wicope@0001fd8a.user.oftc.net) has joined #ceph
[13:15] * analbeard (~shw@5.153.255.226) Quit (Ping timeout: 480 seconds)
[13:18] * cyberhide (~oftc-webi@c-73-189-169-128.hsd1.ca.comcast.net) Quit (Quit: Page closed)
[13:22] * bene (~ben@c-24-60-237-191.hsd1.nh.comcast.net) has joined #ceph
[13:22] * vbellur (~vijay@121.244.87.124) Quit (Ping timeout: 480 seconds)
[13:24] * OutOfNoWhere (~rpb@199.68.195.102) Quit (Ping timeout: 480 seconds)
[13:26] * TomyLobo (~VampiricP@7R2AAAL68.tor-irc.dnsbl.oftc.net) Quit ()
[13:26] * DJComet (~Qiasfah@nx-01.tor-exit.network) has joined #ceph
[13:27] * pvh_sa_ (~pvh@41.164.8.114) Quit (Ping timeout: 480 seconds)
[13:28] * brutuscat (~brutuscat@74.Red-88-8-87.dynamicIP.rima-tde.net) Quit (Read error: Connection reset by peer)
[13:29] * brutuscat (~brutuscat@74.Red-88-8-87.dynamicIP.rima-tde.net) has joined #ceph
[13:31] * t0rn (~ssullivan@2607:fad0:32:a02:56ee:75ff:fe48:3bd3) has joined #ceph
[13:31] * t0rn (~ssullivan@2607:fad0:32:a02:56ee:75ff:fe48:3bd3) has left #ceph
[13:31] * analbeard (~shw@support.memset.com) has joined #ceph
[13:32] * pvh_sa_ (~pvh@41.164.8.114) has joined #ceph
[13:44] * brutuscat (~brutuscat@74.Red-88-8-87.dynamicIP.rima-tde.net) Quit (Remote host closed the connection)
[13:45] * overclk (~overclk@121.244.87.117) Quit (Ping timeout: 480 seconds)
[13:46] * vbellur (~vijay@121.244.87.117) has joined #ceph
[13:47] * brutuscat (~brutuscat@74.Red-88-8-87.dynamicIP.rima-tde.net) has joined #ceph
[13:50] * zhaochao (~zhaochao@125.39.8.238) Quit (Quit: ChatZilla 0.9.91.1 [Iceweasel 31.6.0/20150331233809])
[13:51] * avib (~Ceph@al.secure.elitehosts.com) Quit (Ping timeout: 480 seconds)
[13:56] * DJComet (~Qiasfah@53IAAALDD.tor-irc.dnsbl.oftc.net) Quit ()
[13:56] * PcJamesy (~Deiz@195.169.125.226) has joined #ceph
[14:01] * avib (~Ceph@alt.secure.elitehosts.com) has joined #ceph
[14:01] * morse (~morse@supercomputing.univpm.it) has joined #ceph
[14:06] * kanagaraj (~kanagaraj@121.244.87.117) Quit (Quit: Leaving)
[14:07] * vbellur (~vijay@121.244.87.117) Quit (Ping timeout: 480 seconds)
[14:07] * dalgaaf (uid15138@id-15138.charlton.irccloud.com) Quit (Quit: Connection closed for inactivity)
[14:10] <smerz> how much cpu per OSD recommended for a flash only pool ? we've heard like 1-2GHz / osd. So well for 7 osd's we thought like a 3 GHZ quadcore with HT should do the trick. wouldyou guys agree or are we overlooking something ?
[14:11] <smerz> that would be with 7 osd's on a node. with 2x 10gbit connection
[14:15] <Be-El> ssd based storage has a much higher requirement
[14:15] <Be-El> there's a recent thread on the mailing list for cpu scaling
[14:17] <smerz> any rule of thumb? would it be better to get like an e5 cpu with 6 cores (12 threads) ?
[14:21] <Be-El> 6 cores? recent cpus have 8-18 cores (+ HT
[14:21] <Be-El> at least server cpus
[14:21] <smerz> yeah we got those for hypervisors hehe. but for pure ceph storage node's those cpu's should not be needed right ?
[14:22] * macjack (~macjack@122.146.93.152) has left #ceph
[14:22] * brutuscat (~brutuscat@74.Red-88-8-87.dynamicIP.rima-tde.net) Quit (Read error: Connection reset by peer)
[14:22] <Be-El> it depends on your requirements. the 1-2 GHz rule of thumb is for hdd based storage and replication. if you want to use ssd you will need more cpu performance. if you want to use erasure coding, you will also need more performance
[14:23] <smerz> we were not planning to use erasure coding
[14:23] * vbellur (~vijay@121.244.87.124) has joined #ceph
[14:25] <smerz> we'll benchmark ceph and look at the cpu usage specifically. appreciated your input! :)
[14:26] * PcJamesy (~Deiz@789AAAOCZ.tor-irc.dnsbl.oftc.net) Quit ()
[14:26] * hgjhgjh (~jwandborg@7R2AAAMCQ.tor-irc.dnsbl.oftc.net) has joined #ceph
[14:27] * brutuscat (~brutuscat@74.Red-88-8-87.dynamicIP.rima-tde.net) has joined #ceph
[14:29] <Be-El> smerz: http://blog.gmane.org/gmane.comp.file-systems.ceph.user/day=20150401
[14:29] <Be-El> smerz: http://permalink.gmane.org/gmane.comp.file-systems.ceph.user/18817 that link is better
[14:29] <Be-El> it's the start of the thread about recommendation for ssd-based storage servers
[14:31] * timi (~timi@ip4-89-238-218-34.euroweb.ro) has joined #ceph
[14:31] <smerz> awesome. thanks!
[14:31] <timi> what is the minimum number of osds with replica size of 1 ?
[14:32] <smerz> 1
[14:32] <smerz> but that's not very HA if you know what i mean ;-)
[14:32] <timi> :))
[14:32] <timi> sure
[14:32] <timi> but it don't work with 1 osd remaining
[14:32] <smerz> replica size of 1 in and of itself is not ha
[14:32] <timi> i knoe
[14:32] <timi> w
[14:33] <smerz> hm you're trying to recover your pool still right ?
[14:33] <timi> but I have only 2 osd currently
[14:33] <timi> smerz i gave up :)
[14:34] <timi> but I learned something from this :)
[14:34] <smerz> replica size of 1 means 1 master + 1 copy right? well in that case it depends on the configured minimum copies (Which should be 1). then 1 osd should be enough for a 'degraded' state
[14:34] <timi> never loose mons :)
[14:34] <smerz> 2 osds for a full copie of the data on each
[14:35] <Be-El> size 1 means one instance....no copy at all
[14:36] <timi> i have stale pgs
[14:36] <Be-El> did you also set min_size to 1?
[14:37] * shylesh (~shylesh@121.244.87.124) Quit (Remote host closed the connection)
[14:37] <timi> http://pastebin.com/hqqB4JLG
[14:37] <m0zes> and if min_size 1, it *might* not have a full copy of the data even if you had size 2 set on the pool.
[14:38] * pdrakeweb (~pdrakeweb@cpe-65-185-74-239.neo.res.rr.com) has joined #ceph
[14:38] <m0zes> afaict
[14:38] * kefu (~kefu@114.86.209.84) has joined #ceph
[14:39] <Be-El> timi: with a size of 1 and one osd out, about half of your data is not accessible.
[14:39] <timi> so I sould have 50% + 1 osd for ha ?
[14:39] <timi> at least 3 osds
[14:39] <Be-El> m0zes: as long as the pgs are active+clean before a osd goes down, all copy should be identical
[14:40] <Be-El> timi: for HA you need at least 2 osds, size=2 and min_size=1
[14:40] <Be-El> timi: in that case one osd may go down
[14:40] <Be-El> timi: a better (and more secure) setup requires 3 osds and size=3,min_size=2
[14:40] <Be-El> timi: in that case you do not end up in a split-brain situation
[14:41] <timi> i see
[14:41] * tupper (~tcole@173.38.117.72) Quit (Ping timeout: 480 seconds)
[14:41] <timi> is version 0.94.1 stable enough for production ?
[14:42] <m0zes> Be-El: I'm not entirely sure what the state of the pgs on that node was at the time. it suddenly powered itself off in the middle of the night, and all writes to the mds metadata pool ceased because it couldn't rebuild.
[14:42] <m0zes> regardless, setting min_size 2 seems to have made it much more fault tolerant.
[14:42] <timi> m0zes you can see in the pastebin link provided by me
[14:42] <timi> http://pastebin.com/hqqB4JLG
[14:44] <m0zes> timi: Be-El has been around much longer than I have. his assessment looks correct to me.
[14:44] <m0zes> anyway. 'size 1' means 1 copy of the data *total*
[14:44] * pumtrix (~MaGix@pix.office.vaioni.com) has joined #ceph
[14:44] <Be-El> i'm just another user and i may definitely be wrong in some cases
[14:45] <timi> another problem I have is with os/version specific
[14:45] <timi> on centos 7 the nfs machine that use to export the storage is crashing when the osd goes down
[14:45] <pumtrix> Hello. I have two pyshical instances of ceph. both clustered together in different sites (I didn't set this up) - We just had a power outage in one site, now our east-west traffic has gone through the roof. Is the ceph cluster reconverging together?
[14:46] <timi> http://pastebin.com/XeFrUG6U
[14:46] <timi> looks more like a bug to me ?
[14:46] <smerz> pumtrix, recovery is verio IO and bandwidth intensive
[14:46] <smerz> *very
[14:46] <pumtrix> I thought so.
[14:46] <smerz> so that would be expected from what i hear
[14:46] <pumtrix> the VM's on these clusters are now running very slow.
[14:46] * dgurtner_ (~dgurtner@178.197.231.81) has joined #ceph
[14:46] <pumtrix> I did think it could be this.
[14:46] <pumtrix> Thanks for the heads up.
[14:46] <smerz> best thing you can do is, either nothing or doubling the bandwidth ;-(
[14:47] <pumtrix> I've walked into the biggest mess of my entire life.
[14:47] <pumtrix> haha.
[14:48] <pumtrix> but thanks for the confirmation.
[14:48] * Hemanth (~Hemanth@121.244.87.117) Quit (Ping timeout: 480 seconds)
[14:48] * marrusl (~mark@cpe-24-90-46-248.nyc.res.rr.com) Quit (Quit: bye!)
[14:48] <smerz> no worries. at least it's up right? ;-)
[14:48] <smerz> and eh
[14:48] * marrusl (~mark@cpe-24-90-46-248.nyc.res.rr.com) has joined #ceph
[14:48] <pumtrix> Yeah it's up now haha.
[14:48] <smerz> when your powered down DC comes up again
[14:48] <smerz> the same will happen again
[14:48] <m0zes> pumtrix: you *can* tune the recovery process to make it less painful for production traffic, but it would slow down recovery and probably make it take longer to recover.
[14:48] <pumtrix> I'll give you the background.
[14:49] <pumtrix> We have two instances of proxmox both in different pyshical locations but clustered together, each supposed to have local ceph clusters.
[14:49] * dgurtner (~dgurtner@178.197.231.80) Quit (Ping timeout: 480 seconds)
[14:49] <pumtrix> one of the clusters isn't used (which is the one with the power outage)
[14:49] <pumtrix> when it died
[14:50] <m0zes> timi: probably related to the same 'size 1' issue. the osd went down, writes and reads stopped because half the data is missing.
[14:50] <pumtrix> the other cluster's vm's lost disk.
[14:50] <pumtrix> haha
[14:50] <pumtrix> so apprantely it's not local.
[14:50] <pumtrix> need to start getting my head around this asap.
[14:50] * overclk (~overclk@121.244.87.117) has joined #ceph
[14:52] <timi> thanks, I will add more osds and do more testing
[14:52] <smerz> ceph is no rocket science. there is a good book that came out recently which gives a good introduction i think
[14:54] <anorak> smerz: which book?
[14:54] <smerz> "learning ceph"
[14:54] <timi> i think it is when it comes to recover data from osds without mons :)
[14:55] <smerz> it's not very deep in the internals but covers many areas/features
[14:56] <anorak> smerz: I would agree with you that it is not very deep. I would rather look at the online documentation. That is my opinion. :)
[14:56] * hgjhgjh (~jwandborg@7R2AAAMCQ.tor-irc.dnsbl.oftc.net) Quit ()
[14:57] <timi> agree the online doc is good enough
[14:57] * tupper (~tcole@2001:420:2280:1272:8900:f9b8:3b49:567e) has joined #ceph
[14:58] <m0zes> docs are pretty good. and for missing/unclear documentation irc+mailing list + the occasional source dive.
[15:00] <smerz> anorak, very true. i had hoped for more internals. but the online documentation is very good yes
[15:02] <smerz> playing with it i guess is one of the best ways to learn
[15:02] <smerz> hehe
[15:03] * rlrevell (~leer@vbo1.inmotionhosting.com) has joined #ceph
[15:05] <timi> do the guys from ceph have paid support ?
[15:06] <darkfader> timi: yes
[15:06] <darkfader> since 2013 i think
[15:06] <darkfader> now it'll be via redhat i guess???
[15:07] <timi> i see, that's good to know
[15:07] <darkfader> yeah but now i'm scratching my head if they'd still support non RH platforms like inktank used to
[15:08] * brad_mssw (~brad@66.129.88.50) has joined #ceph
[15:08] <timi> hm, centos is considerated to be RH ?
[15:10] * dyasny (~dyasny@104.158.33.109) has joined #ceph
[15:14] * derjohn_mob (~aj@fw.gkh-setu.de) Quit (Ping timeout: 480 seconds)
[15:16] <smerz> well technically yes. but do they support it or not, from a political point of view is a whole different story :S
[15:18] * avib (~Ceph@alt.secure.elitehosts.com) Quit (Ping timeout: 480 seconds)
[15:19] <jcsp1> no need to speculate, the data sheed is here: http://www.redhat.com/en/files/resources/en-rhst-ceph-storage-datasheet-INC0226549.pdf
[15:19] <jcsp1> *sheet
[15:19] * georgem (~Adium@fwnat.oicr.on.ca) has joined #ceph
[15:21] <smerz> ubuntu/centos/rhel
[15:21] <smerz> nice :)
[15:22] <smerz> or? Kernel module support: Red Hat Enterprise Linux 7.1 or higher
[15:26] * Arcturus (~VampiricP@7R2AAAMGJ.tor-irc.dnsbl.oftc.net) has joined #ceph
[15:28] * xarses (~andreww@c-73-202-191-48.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[15:31] * avib (~Ceph@al.secure.elitehosts.com) has joined #ceph
[15:31] * primechuck (~primechuc@host-95-2-129.infobunker.com) has joined #ceph
[15:32] * yanzheng (~zhyan@171.216.95.141) Quit (Quit: This computer has gone to sleep)
[15:32] * yanzheng (~zhyan@171.216.95.141) has joined #ceph
[15:35] * Cybert1nus (~Cybertinu@cybertinus.customer.cloud.nl) has joined #ceph
[15:36] * Cybert1nus (~Cybertinu@cybertinus.customer.cloud.nl) Quit (Remote host closed the connection)
[15:36] * Cybertinus (~Cybertinu@cybertinus.customer.cloud.nl) Quit (Read error: Connection reset by peer)
[15:37] * overclk (~overclk@121.244.87.117) Quit (Remote host closed the connection)
[15:37] * harold (~hamiller@71-94-227-123.dhcp.mdfd.or.charter.com) has joined #ceph
[15:38] * Cybertinus (~Cybertinu@cybertinus.customer.cloud.nl) has joined #ceph
[15:40] * harold (~hamiller@71-94-227-123.dhcp.mdfd.or.charter.com) Quit ()
[15:40] * jeevan_ullas (~Deependra@114.143.35.188) Quit (Quit: Textual IRC Client: www.textualapp.com)
[15:42] * vbellur (~vijay@121.244.87.124) Quit (Ping timeout: 480 seconds)
[15:42] * derjohn_mob (~aj@tmo-111-145.customers.d1-online.com) has joined #ceph
[15:44] * rendar (~I@host195-179-dynamic.10-87-r.retail.telecomitalia.it) Quit (Ping timeout: 480 seconds)
[15:46] <rlrevell> hey all, i am hitting what looks like a pretty scary bug in ceph, short version is, if two openstack instances using ceph storage try to run iozone at the same time, one of them will fail with an error like "read: Bad file descriptor", "read: Invalid argument", or "lseek: Bad file descriptor". running two iozones on the same instance does not show the same issue. can someone point me to what kind of information should be included in a bug report, or
[15:47] * hasues (~hazuez@108-236-232-243.lightspeed.knvltn.sbcglobal.net) has joined #ceph
[15:47] * hasues (~hazuez@108-236-232-243.lightspeed.knvltn.sbcglobal.net) has left #ceph
[15:47] * brutuscat (~brutuscat@74.Red-88-8-87.dynamicIP.rima-tde.net) Quit (Read error: Connection reset by peer)
[15:47] * rendar (~I@host195-179-dynamic.10-87-r.retail.telecomitalia.it) has joined #ceph
[15:48] <jcsp1> rlrevell: so is each instance using a different RBD image or?
[15:48] * brutuscat (~brutuscat@74.Red-88-8-87.dynamicIP.rima-tde.net) has joined #ceph
[15:49] <jcsp1> smerz: when it comes to kernel modules, it's pretty much up to whoever is making your kernel (i.e. the distro)
[15:51] * karnan (~karnan@106.51.134.150) Quit (Quit: Leaving)
[15:53] <rlrevell> jcsp1: i use the "boot from image (creates a new volume)" for each in openstack so separate volumes
[15:55] * lpabon (~quassel@24-151-54-34.dhcp.nwtn.ct.charter.com) has joined #ceph
[15:56] * Arcturus (~VampiricP@7R2AAAMGJ.tor-irc.dnsbl.oftc.net) Quit ()
[15:56] * timi (~timi@ip4-89-238-218-34.euroweb.ro) Quit ()
[15:56] * yuastnav (~pico@37.187.129.166) has joined #ceph
[15:57] * lurbs (user@202.78.240.89) Quit (Ping timeout: 480 seconds)
[15:57] * derjohn_mobi (~aj@tmo-113-92.customers.d1-online.com) has joined #ceph
[16:00] * nsoffer (~nsoffer@bzq-109-64-255-118.red.bezeqint.net) Quit (Quit: Segmentation fault (core dumped))
[16:00] * yghannam (~yghannam@0001f8aa.user.oftc.net) has joined #ceph
[16:02] * cok (~chk@2a02:2350:18:1010:ecc0:43f8:5bdb:ced4) has left #ceph
[16:03] * xarses (~andreww@12.164.168.117) has joined #ceph
[16:03] * derjohn_mob (~aj@tmo-111-145.customers.d1-online.com) Quit (Ping timeout: 480 seconds)
[16:03] * yanzheng (~zhyan@171.216.95.141) Quit (Quit: This computer has gone to sleep)
[16:03] <devicenull> is there a way to force radosgw garbage collection?
[16:04] * jrankin (~jrankin@d53-64-170-236.nap.wideopenwest.com) has joined #ceph
[16:04] <devicenull> ah
[16:04] <devicenull> radosgw-admin gc process
[16:04] <devicenull> should RTFM before asking
[16:06] * dmlb2000 (~dmlb2000@71-95-122-234.dhcp.mdfd.or.charter.com) Quit (Remote host closed the connection)
[16:08] * yanzheng (~zhyan@171.216.95.141) has joined #ceph
[16:08] * shaunm (~shaunm@74.215.76.114) Quit (Quit: Ex-Chat)
[16:09] * shaunm (~shaunm@74.215.76.114) has joined #ceph
[16:09] * yanzheng (~zhyan@171.216.95.141) Quit ()
[16:17] * jrankin (~jrankin@d53-64-170-236.nap.wideopenwest.com) Quit (Read error: Connection reset by peer)
[16:17] * wushudoin (~wushudoin@209.132.181.86) Quit (Remote host closed the connection)
[16:18] * pvh_sa_ (~pvh@41.164.8.114) Quit (Ping timeout: 480 seconds)
[16:19] <rlrevell> jcsp1: and now can no longer reproduce the problem... weird
[16:20] * wushudoin (~wushudoin@209.132.181.86) has joined #ceph
[16:20] * jrankin (~jrankin@d53-64-170-236.nap.wideopenwest.com) has joined #ceph
[16:21] * b0e (~aledermue@213.95.25.82) Quit (Quit: Leaving.)
[16:22] * MentalRay (~MRay@MTRLPQ42-1176054809.sdsl.bell.ca) has joined #ceph
[16:24] * i_m (~ivan.miro@83.149.35.207) has joined #ceph
[16:25] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) has joined #ceph
[16:25] * psibox_ (~dreger@zlogin2.physik.fu-berlin.de) Quit (Quit: leaving)
[16:26] * yuastnav (~pico@2WVAAB8MW.tor-irc.dnsbl.oftc.net) Quit ()
[16:26] * Frostshifter (~matx@nx-01.tor-exit.network) has joined #ceph
[16:29] * rendar (~I@host195-179-dynamic.10-87-r.retail.telecomitalia.it) Quit (Ping timeout: 480 seconds)
[16:29] * dgurtner (~dgurtner@178.197.231.49) has joined #ceph
[16:31] * dgurtner_ (~dgurtner@178.197.231.81) Quit (Ping timeout: 480 seconds)
[16:32] * JV (~chatzilla@static-50-53-42-60.bvtn.or.frontiernet.net) has joined #ceph
[16:36] * derjohn_mobi (~aj@tmo-113-92.customers.d1-online.com) Quit (Ping timeout: 480 seconds)
[16:37] * rdas (~rdas@122.168.75.126) Quit (Quit: Leaving)
[16:42] * c4tech (~c4tech@199.91.185.156) has joined #ceph
[16:42] * rendar (~I@host168-181-dynamic.3-87-r.retail.telecomitalia.it) has joined #ceph
[16:43] * oro (~oro@2001:620:20:16:2d63:22e0:52c0:e2e3) Quit (Ping timeout: 480 seconds)
[16:43] * MACscr (~Adium@2601:d:c800:de3:30f7:6d93:6a03:5aec) has joined #ceph
[16:45] * visbits (~textual@8.29.138.28) has joined #ceph
[16:45] <visbits> im so happy i upgraded to hammer, all my bs is gone
[16:45] <smerz> can you elaborate which bs? :)
[16:45] <smerz> (just out of curiosity)
[16:46] <fxmulder> he has literally been hitting bulls with hammers and they no longer poop in his yard
[16:46] <visbits> whenever i added or removed Osd the rbd drivers would stop communicating correctly, basically the rbd driver and librbd needed a full reboot to begin working again.
[16:47] <visbits> it would log that it ack'd the change, but nothing happened
[16:49] * bkopilov (~bkopilov@bzq-79-183-126-150.red.bezeqint.net) Quit (Ping timeout: 480 seconds)
[16:53] * amote (~amote@121.244.87.116) Quit (Quit: Leaving)
[16:53] * sleinen1 (~Adium@2001:620:0:82::107) Quit (Ping timeout: 480 seconds)
[16:56] * Frostshifter (~matx@7R2AAAMJX.tor-irc.dnsbl.oftc.net) Quit ()
[16:56] * _s1gma (~Dinnerbon@kbtr2ce.tor-relay.me) has joined #ceph
[16:57] * JV (~chatzilla@static-50-53-42-60.bvtn.or.frontiernet.net) Quit (Ping timeout: 480 seconds)
[16:58] <smerz> visbits, that sounds indeed awful. glad you got it fixed! :)
[16:59] <visbits> i was on giant
[17:01] * gregmark (~Adium@68.87.42.115) has joined #ceph
[17:03] * T1w (~jens@node3.survey-it.dk) Quit (Ping timeout: 480 seconds)
[17:04] * brutusca_ (~brutuscat@74.Red-88-8-87.dynamicIP.rima-tde.net) has joined #ceph
[17:04] * brutuscat (~brutuscat@74.Red-88-8-87.dynamicIP.rima-tde.net) Quit (Remote host closed the connection)
[17:13] * sleinen (~Adium@84-72-160-233.dclient.hispeed.ch) has joined #ceph
[17:13] * clickerbuis (~oftc-webi@2e0a7289.test.dnsbl.oftc.net) has joined #ceph
[17:14] * clickerbuis (~oftc-webi@2e0a7289.test.dnsbl.oftc.net) has left #ceph
[17:15] * sleinen1 (~Adium@2001:620:0:82::101) has joined #ceph
[17:19] * analbeard (~shw@support.memset.com) Quit (Quit: Leaving.)
[17:19] * xdeller (~xdeller@h195-91-128-218.ln.rinet.ru) Quit (Read error: Connection reset by peer)
[17:19] * xdeller (~xdeller@h195-91-128-218.ln.rinet.ru) has joined #ceph
[17:19] * Elwell_ (~elwell@106-68-108-136.dyn.iinet.net.au) has joined #ceph
[17:21] * sleinen (~Adium@84-72-160-233.dclient.hispeed.ch) Quit (Ping timeout: 480 seconds)
[17:22] * Elwell (~elwell@58-7-85-157.dyn.iinet.net.au) Quit (Ping timeout: 480 seconds)
[17:23] * vbellur (~vijay@122.167.250.154) has joined #ceph
[17:26] * oro (~oro@80-219-254-208.dclient.hispeed.ch) has joined #ceph
[17:26] * _s1gma (~Dinnerbon@789AAAOMG.tor-irc.dnsbl.oftc.net) Quit ()
[17:26] * Silentspy (~tritonx@ncc-1701-a.tor-exit.network) has joined #ceph
[17:28] * shakamunyi (~shakamuny@c-67-180-191-38.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[17:28] * debian112 (~bcolbert@24.126.201.64) has joined #ceph
[17:29] * kawa2014 (~kawa@212.77.3.87) Quit (Quit: Leaving)
[17:29] * brutusca_ (~brutuscat@74.Red-88-8-87.dynamicIP.rima-tde.net) Quit (Read error: Connection reset by peer)
[17:30] * brutuscat (~brutuscat@74.Red-88-8-87.dynamicIP.rima-tde.net) has joined #ceph
[17:31] * joshd1 (~jdurgin@68-119-140-18.dhcp.ahvl.nc.charter.com) has joined #ceph
[17:41] * JV (~chatzilla@204.14.239.53) has joined #ceph
[17:42] * TMM (~hp@sams-office-nat.tomtomgroup.com) Quit (Quit: Ex-Chat)
[17:43] * pumtrix (~MaGix@pix.office.vaioni.com) Quit (Read error: No route to host)
[17:44] * reed (~reed@75-101-54-131.dsl.static.fusionbroadband.com) has joined #ceph
[17:44] * cholcombe (~chris@pool-108-42-124-94.snfcca.fios.verizon.net) has joined #ceph
[17:48] * brutuscat (~brutuscat@74.Red-88-8-87.dynamicIP.rima-tde.net) Quit (Remote host closed the connection)
[17:48] * brutuscat (~brutuscat@74.Red-88-8-87.dynamicIP.rima-tde.net) has joined #ceph
[17:50] * derjohn_mob (~aj@x590c15ac.dyn.telefonica.de) has joined #ceph
[17:52] * Nacer (~Nacer@2001:41d0:fe82:7200:cca4:b00b:e663:5ea2) Quit (Remote host closed the connection)
[17:53] * Nacer (~Nacer@2001:41d0:fe82:7200:cca4:b00b:e663:5ea2) has joined #ceph
[17:53] * alram (~alram@cpe-172-250-2-46.socal.res.rr.com) has joined #ceph
[17:56] * Silentspy (~tritonx@0SGAAAKUD.tor-irc.dnsbl.oftc.net) Quit ()
[17:56] * Sun7zu (~Uniju@mail.calyx.com) has joined #ceph
[18:00] * i_m (~ivan.miro@83.149.35.207) Quit (Ping timeout: 480 seconds)
[18:09] * xarses (~andreww@12.164.168.117) Quit (Ping timeout: 480 seconds)
[18:09] * daniel2_ (~dshafer@0001b605.user.oftc.net) has joined #ceph
[18:09] * i_m (~ivan.miro@83.149.35.19) has joined #ceph
[18:10] * kefu is now known as kefu|afk
[18:10] * Nacer (~Nacer@2001:41d0:fe82:7200:cca4:b00b:e663:5ea2) Quit (Remote host closed the connection)
[18:10] * Nacer (~Nacer@2001:41d0:fe82:7200:cca4:b00b:e663:5ea2) has joined #ceph
[18:13] * pvh_sa_ (~pvh@105-236-14-252.access.mtnbusiness.co.za) has joined #ceph
[18:13] * BManojlovic (~steki@cable-89-216-238-57.dynamic.sbb.rs) has joined #ceph
[18:15] * shakamunyi (~shakamuny@209.66.74.34) has joined #ceph
[18:18] * xarses (~andreww@12.164.168.117) has joined #ceph
[18:22] * lx0 (~aoliva@lxo.user.oftc.net) Quit (Ping timeout: 480 seconds)
[18:24] * sugoruyo (~georgev@paarthurnax.esc.rl.ac.uk) Quit (Quit: I'm going home!)
[18:26] * Sun7zu (~Uniju@53IAAALTW.tor-irc.dnsbl.oftc.net) Quit ()
[18:27] * bandrus (~brian@59.sub-70-211-66.myvzw.com) has joined #ceph
[18:29] * DV__ (~veillard@2001:41d0:1:d478::1) Quit (Ping timeout: 480 seconds)
[18:29] * shakamunyi (~shakamuny@209.66.74.34) Quit (Remote host closed the connection)
[18:37] * marrusl (~mark@cpe-24-90-46-248.nyc.res.rr.com) Quit (Remote host closed the connection)
[18:38] * burley (~khemicals@cpe-98-28-239-78.cinci.res.rr.com) Quit (Quit: burley)
[18:38] * DV (~veillard@2001:41d0:a:f29f::1) has joined #ceph
[18:40] * kefu|afk (~kefu@114.86.209.84) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[18:41] * dschneller (~textual@89.246.242.138) has joined #ceph
[18:44] * JV_ (~chatzilla@204.14.239.107) has joined #ceph
[18:46] * Elwell (~elwell@106-68-39-223.dyn.iinet.net.au) has joined #ceph
[18:47] * shakamunyi (~shakamuny@209.66.74.34) has joined #ceph
[18:47] <dschneller> Hello! We're experiencing two flapping OSDs, making our prod system unusable. They keep dying hitting the suicide timeout.
[18:47] <dschneller> 0.80.8
[18:48] * MentalRay (~MRay@MTRLPQ42-1176054809.sdsl.bell.ca) Quit (Quit: This computer has gone to sleep)
[18:48] <dschneller> Network seems to be ok, we can ping the dedicated clsuter interface between the two hosts with these osds
[18:49] <dschneller> ubuntu 14.04
[18:49] * JV (~chatzilla@204.14.239.53) Quit (Ping timeout: 480 seconds)
[18:49] * Elwell_ (~elwell@106-68-108-136.dyn.iinet.net.au) Quit (Ping timeout: 480 seconds)
[18:49] * JV_ is now known as JV
[18:49] <dschneller> 4x DELL PowerEdge, dedicted storage nodes with 12x4TB OSDs each
[18:49] <dschneller> 96GB RAM
[18:49] <dschneller> Swappiness 10
[18:50] <dschneller> Any ideas? Hearbeat between the two is reported to fail
[18:51] <dschneller> 2015-05-08 18:49:23.276978 7ffab0c21700 1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7ffaacc19700' had timed out after 15
[18:51] <dschneller> lots of these
[18:51] * sjmtest (uid32746@id-32746.uxbridge.irccloud.com) has joined #ceph
[18:51] <dschneller> -22> 2015-05-08 18:46:26.486658 7f70874f9700 1 -- 10.102.4.12:0/24240 <== osd.4 10.102.4.11:6808/12472 82 ==== osd_ping(you_died e26647 stamp 2015-05-08 18:46:26.480624) v2 ==== 47+0+0 (3993534747 0 0) 0x4dcb5100 con 0x4d46a520
[18:51] <dschneller> -21> 2015-05-08 18:46:26.486677 7f70874f9700 1 -- 10.102.4.12:0/24240 <== osd.38 10.102.5.13:6801/7047 82 ==== osd_ping(you_died e26647 stamp 2015-05-08 18:46:26.480624) v2 ==== 47+0+0 (3993534747 0 0) 0x2f029880 con 0x4d46a260
[18:51] <dschneller> -20> 2015-05-08 18:46:26.486696 7f70874f9700 1 -- 10.102.4.12:0/24240 <== osd.38 10.102.4.13:6801/7047 82 ==== osd_ping(you_died e26647 stamp 2015-05-08 18:46:26.480624) v2 ==== 47+0+0 (3993534747 0 0) 0x4ee64d80 con 0x4d469fa0
[18:51] <dschneller> -19> 2015-05-08 18:46:26.486715 7f70874f9700 1 -- 10.102.4.12:0/24240 <== osd.36 10.102.5.13:6821/8126 82 ==== osd_ping(you_died e26647 stamp 2015-05-08 18:46:26.480624) v2 ==== 47+0+0 (3993534747 0 0) 0x4c526700 con 0x4d469ce0
[18:51] <dschneller> -18> 2015-05-08 18:46:26.486734 7f70874f9700 1 -- 10.102.4.12:0/24240 <== osd.36 10.102.4.13:6831/8126 82 ==== osd_ping(you_died e26647 stamp 2015-05-08 18:46:26.480624) v2 ==== 47+0+0 (3993534747 0 0) 0x4e25a300 con 0x4d469a20
[18:52] <dschneller> We suspect that this one OSD takes too long to come up / respond, so that others mark it as down time and time again,
[18:53] <Be-El> what happens it you shut down one of the osd and wait until the recovery/backfilling is finished?
[18:54] * sjm (~sjm@pool-173-70-76-86.nwrknj.fios.verizon.net) Quit (Ping timeout: 480 seconds)
[18:54] <dschneller> Not yet tried that, because we had hoped to get this one up and running again without having to wait for the backfill.
[18:54] <dschneller> It is quite a bit of data that would have to be shuffled around.
[18:55] <Be-El> sure, up to 48 tb
[18:55] <dschneller> However, if there is nothing else we should try, that would probably be the next best option.
[18:55] <Be-El> but if both osds block each other due to backfilling, this is the best way to get a stable system
[18:55] <dschneller> well, we are not _that_ full
[18:55] * char|on (~ls@dslb-178-009-182-130.178.009.pools.vodafone-ip.de) Quit (Quit: Leaving)
[18:56] <dschneller> But still.
[18:56] <dschneller> Now stopped one of the 2.
[18:56] <Be-El> you can try to reduce the backfill traffic, e.g. reducing the number of parallel backfills to 1
[18:56] * EdGruberman (~neobenedi@static-ip-85-25-103-119.inaddr.ip-pool.com) has joined #ceph
[18:58] <dschneller> thanks. did that already.
[18:58] <dschneller> also osd recovery max active = 1
[18:59] * ebeerman (~ebeerman@64.202.160.88) has joined #ceph
[18:59] <Be-El> if you use cfq io schedulers on the osd disks, you can also set io sched classes for recovery/backfill, e.g. to idle or a low priority class
[19:01] <dschneller> colleague (on facetime) says that's not available on ubuntu. using noop scheduler iirc.
[19:02] * mattch (~mattch@pcw3047.see.ed.ac.uk) Quit (Ping timeout: 480 seconds)
[19:02] <dschneller> marking it out manually now to avoid having to wait for the monitor's timeout.
[19:02] <dschneller> backfill commencing.
[19:02] <Be-El> is the remaining troubled osd stable now?
[19:03] <aarontc> does anyone have troubleshooting advice for "inconsistent" PGs with 0 copies of the objects across all replicas?
[19:03] <dschneller> remaining one still complaining
[19:03] <dschneller> 2015-05-08 19:03:47.221012 7f2bfe4de700 1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7f2bfb4d8700' had timed out after 15
[19:04] <dschneller> I suspect it will harakiri in a moment
[19:05] <Be-El> are both flapping osds in the same host?
[19:05] <dschneller> no
[19:05] <dschneller> different hosts
[19:05] * bkopilov (~bkopilov@bzq-79-176-125-104.red.bezeqint.net) has joined #ceph
[19:10] * MentalRay (~MRay@MTRLPQ42-1176054809.sdsl.bell.ca) has joined #ceph
[19:11] <dschneller> However, so far the remaining one is still alive and did not commit suicide.
[19:11] * shakamunyi (~shakamuny@209.66.74.34) Quit (Ping timeout: 480 seconds)
[19:11] * Concubidated (~Adium@netblock-75-79-129-24.dslextreme.com) has joined #ceph
[19:12] * LPustina (~textual@xdsl-87-79-176-38.netcologne.de) has joined #ceph
[19:12] <ebeerman> Hello, I don't mean to interrupt your conversation - just have a question when someone has a minute. I've done some looking around online but haven't seen anything specific to this use case. Is there a way to optimize a HEAD call on a multipart object in the object store so that the gateway doesn't have to cycle through each part when calculating the headers to return? We've noticed that this API call tends to be very slow for multipart object
[19:12] <ebeerman> s and are just looking for ways to speed it up.
[19:12] <dschneller> Be-el: LPustina is the facetime colleague. pleased to introducue you.
[19:13] * derjohn_mob (~aj@x590c15ac.dyn.telefonica.de) Quit (Ping timeout: 480 seconds)
[19:13] * shakamunyi (~shakamuny@209.66.74.34) has joined #ceph
[19:14] * shakamunyi (~shakamuny@209.66.74.34) Quit (Read error: Connection reset by peer)
[19:14] * barra204 (~shakamuny@209.66.74.34) has joined #ceph
[19:14] <dschneller> Number of object degraded goes up/down. We'll try restarting the remaining OSD to see if it maybe is somehow still in a "broken" state from when the other one was still there.
[19:15] <Be-El> ebeerman: i haven't used the gateway yet, but there's an option to use the 100-continue optimization for http
[19:15] <Be-El> ebeerman: maybe this speeds up things for you
[19:15] <LPustina> The second OSDs doesn't seem to recover after we shut down and marked the first one as out.
[19:16] * Concubidated (~Adium@netblock-75-79-129-24.dslextreme.com) Quit (Read error: Connection reset by peer)
[19:16] <Be-El> LPustina: do you have any pools which may be unaccessible if both osds are not present?
[19:16] * whydidyoustealmynick (~shakamuny@209.66.74.34) has joined #ceph
[19:17] * barra204 (~shakamuny@209.66.74.34) Quit (Read error: Connection reset by peer)
[19:17] <LPustina> Be-El: Yes. There is are large pools for radosgw.
[19:17] * whydidyoustealmynick (~shakamuny@209.66.74.34) Quit (Read error: Connection reset by peer)
[19:18] * shakamunyi (~shakamuny@209.66.74.34) has joined #ceph
[19:18] * Concubidated (~Adium@netblock-75-79-129-24.dslextreme.com) has joined #ceph
[19:19] <ebeerman> Thanks Be-El I'll look into it.
[19:20] <Be-El> LPustina: are cpus/disks/network links saturated on the flapping osd?
[19:20] * sjm (~sjm@pool-173-70-76-86.nwrknj.fios.verizon.net) has joined #ceph
[19:21] * marrusl (~mark@cpe-24-90-46-248.nyc.res.rr.com) has joined #ceph
[19:22] <LPustina> Be-El: Disks and network are under load, but neither is saturated.
[19:22] <LPustina> Same holds for CPU.
[19:23] * shylesh (~shylesh@123.136.222.117) has joined #ceph
[19:23] * brutuscat (~brutuscat@74.Red-88-8-87.dynamicIP.rima-tde.net) Quit (Read error: Connection reset by peer)
[19:26] <dschneller> We have now stopped the other misbehaving OSD as well.
[19:26] <dschneller> Backfilling is going on-
[19:26] * shakamunyi (~shakamuny@209.66.74.34) Quit (Ping timeout: 480 seconds)
[19:26] <dschneller> Which parameters could we may change to make that utilize resources more?
[19:26] <dschneller> Which parameters could we maybe change to make that utilize resources more?
[19:26] * EdGruberman (~neobenedi@789AAAORT.tor-irc.dnsbl.oftc.net) Quit ()
[19:26] * Ralth (~airsoftgl@23.95.43.74) has joined #ceph
[19:26] * dgurtner (~dgurtner@178.197.231.49) Quit (Ping timeout: 480 seconds)
[19:28] <Be-El> dschneller: you can try to increase the timeout to prevent the osds from being marked as out
[19:30] <dschneller> Be-El: I might have phrased that poorly. The systems have no visible saturation on io/cpu/net. The backfilling takes place wiht about 500 object/s // 20-30mb/s.
[19:30] <dschneller> We are looking for ways to maybe speed that up.
[19:30] <dschneller> Network link is 2x1GB bonded, so there is room left there.
[19:30] * brutuscat (~brutuscat@74.Red-88-8-87.dynamicIP.rima-tde.net) has joined #ceph
[19:31] <Be-El> dschneller: set osd-max-backfills to a higher number
[19:31] <Be-El> dschneller: but client io will suffer
[19:32] <dschneller> clients are mostly dead anyway
[19:32] <Be-El> how many hosts and osds do you have?
[19:33] <dschneller> 4 hosts, 48 OSDs
[19:33] <LPustina> 12 OSDs per host.
[19:33] <dschneller> [18:49:29] <dschneller> 4x DELL PowerEdge, dedicted storage nodes with 12x4TB OSDs each
[19:33] <dschneller> [18:49:32] <dschneller> 96GB RAM
[19:33] <dschneller> [18:49:38] <dschneller> Swappiness 10
[19:34] * shakamunyi (~shakamuny@209.66.74.34) has joined #ceph
[19:34] <Be-El> so if one osd has to be refilled, 3 hosts with 12 osds (that can easily saturate 2x1gb) are trashing the host with the osd
[19:34] <Be-El> .oO ( reminds me of our setup ;-) )
[19:35] <Be-El> dschneller / LPustina: if you use bonded links, which lacp hashing method do you use?
[19:35] <LPustina> mode bond-xmit_hash_policy layer3+4
[19:36] <Be-El> does the switch also support layer3+4 (or rephrased: do you get inbound traffic on both interfaces)?
[19:36] <dschneller> Be-El: iperf measurements with parallel connections showed 2GBit
[19:36] * lurbs (user@uber.geek.nz) has joined #ceph
[19:36] <dschneller> Yes.
[19:37] <LPustina> Yes, we tested that extensively.
[19:37] <Be-El> is the remaining flapping osd still alive?
[19:38] <Be-El> or a both down and out now?
[19:38] * mykola (~Mikolaj@91.225.203.160) has joined #ceph
[19:38] * dalgaaf (uid15138@id-15138.charlton.irccloud.com) has joined #ceph
[19:39] <dschneller> both down and out
[19:39] <dschneller> backfilling running continuously now
[19:40] <dschneller> 2015-05-08 19:39:40.293499 mon.0 [INF] pgmap v25635917: 36388 pgs: 38 active+recovery_wait, 35516 active+clean, 37 active+recovering, 65 active+degraded+remapped+backfilling, 6 stale+down+peering, 1 active+remapped, 6 down+peering, 702 active+degraded+remapped+wait_backfill, 17 remapped+incomplete; 4655 GB data, 13961 GB used, 153 TB / 167 TB avail; 0 B/s rd, 43678 B/s wr, 11 op/s; 3334845/66794154 objects degraded (4.993%); 151 MB/s, 929 keys/s, 331
[19:40] <dschneller> objects/s recovering
[19:42] <Be-El> that's a lot of small objects
[19:42] * bkopilov (~bkopilov@bzq-79-176-125-104.red.bezeqint.net) Quit (Ping timeout: 480 seconds)
[19:43] * pdrakewe_ (~pdrakeweb@cpe-65-185-74-239.neo.res.rr.com) has joined #ceph
[19:44] <Be-El> dschneller: to get rid of the non-active objects you need to restart at least one of the missing osds
[19:46] * TMM (~hp@178-84-46-106.dynamic.upc.nl) has joined #ceph
[19:46] * bkopilov (~bkopilov@bzq-79-182-180-120.red.bezeqint.net) has joined #ceph
[19:48] * MentalRay (~MRay@MTRLPQ42-1176054809.sdsl.bell.ca) Quit (Quit: This computer has gone to sleep)
[19:50] * pdrakeweb (~pdrakeweb@cpe-65-185-74-239.neo.res.rr.com) Quit (Ping timeout: 480 seconds)
[19:51] * MentalRay (~MRay@MTRLPQ42-1176054809.sdsl.bell.ca) has joined #ceph
[19:53] * jclm (~jclm@ip24-253-45-236.lv.lv.cox.net) has joined #ceph
[19:56] * lxo (~aoliva@lxo.user.oftc.net) has joined #ceph
[19:56] * Ralth (~airsoftgl@8Q4AAAN6T.tor-irc.dnsbl.oftc.net) Quit ()
[19:57] * brutuscat (~brutuscat@74.Red-88-8-87.dynamicIP.rima-tde.net) Quit (Remote host closed the connection)
[19:59] * bkopilov (~bkopilov@bzq-79-182-180-120.red.bezeqint.net) Quit (Ping timeout: 480 seconds)
[20:01] * bkopilov (~bkopilov@bzq-79-177-2-127.red.bezeqint.net) has joined #ceph
[20:04] <dschneller> Be-El: Yes. We plan on waiting for it to finish recovery with the remaining 46.
[20:05] * shaunm (~shaunm@74.215.76.114) Quit (Ping timeout: 480 seconds)
[20:05] <dschneller> Then we intend to check the client functionality with those.
[20:05] <dschneller> After that we need to diagnose what happened to the two down OSDs in the first place.
[20:06] <Be-El> dschneller: the down pgs might be a problem for the clients
[20:07] <LPustina> Be-El: Should they be active and clean after recovery / backfilling?
[20:07] <dschneller> Am I wrong to assume that once the recovery is complete all PGs should be back?
[20:07] <LPustina> Shouldn't **
[20:08] <Be-El> it depends on your pool setup. if you have pool with a replication size of 2, then there will always be pgs that are only present on the failed osds
[20:09] * derjohn_mob (~aj@x590c15ac.dyn.telefonica.de) has joined #ceph
[20:10] <dschneller> damn. you are rght.
[20:10] <dschneller> I was under the assumption that everything was on 3 replicas, but that is a different cluster.
[20:10] <dschneller> this one has RDB volumes in a pool with 2.
[20:11] <Be-El> otherwise you wouldn't have down+something pgs
[20:11] * bkopilov (~bkopilov@bzq-79-177-2-127.red.bezeqint.net) Quit (Ping timeout: 480 seconds)
[20:11] * bkopilov (~bkopilov@bzq-109-67-123-254.red.bezeqint.net) has joined #ceph
[20:11] <Be-El> are the vms backed by the cluster still active?
[20:12] <dschneller> yes
[20:13] <Be-El> how much write activity do they have?
[20:14] <dschneller> how do you mean? what would qualify for "much"?
[20:14] <dschneller> Under normal circumstances there is a fair amount of writes going on, because there is elasticsearch, mongodb etc. in there.
[20:14] <Be-El> that's a good question *g* i asking because of the way i think ceph recovers if a prior osd is rejoining the cluster
[20:15] <dschneller> could you elaborate?
[20:16] <Be-El> the returning osd announces its pgs to the monitor. the monitors decide which pgs are still valid on the returning osd, so the content on other osds is removed if they were back filled during a recovery
[20:16] <Be-El> the amount of traffic for these pgs should be low
[20:16] <Be-El> the problem are pg that have been modified
[20:16] <Be-El> they have to be recovered/backfilled/whatever
[20:16] <Be-El> that's how i think it is working....i haven't validated that with the source code yet
[20:17] <Be-El> to make a long story short: if you restart the osd there's a good chance it will recover quickly
[20:18] * LPustina_ (~textual@xdsl-87-79-176-38.netcologne.de) has joined #ceph
[20:19] <dschneller> I see.
[20:20] <dschneller> We were wondering about what would happen when we brought one back regarding the backfilled stuff while both were down,. if you are right, hopefully it would indeed be quick.
[20:20] * bkopilov (~bkopilov@bzq-109-67-123-254.red.bezeqint.net) Quit (Ping timeout: 480 seconds)
[20:20] <dschneller> However, we still don;t know what caused this mess in the first place, so I fear bringing one of those back might be more difficult that one would hope for.
[20:20] * bkopilov (~bkopilov@bzq-79-180-153-78.red.bezeqint.net) has joined #ceph
[20:22] * dgurtner (~dgurtner@217-162-119-191.dynamic.hispeed.ch) has joined #ceph
[20:23] * LPustina (~textual@xdsl-87-79-176-38.netcologne.de) Quit (Ping timeout: 480 seconds)
[20:26] * _br_ (~kalleeen@5.61.34.63) has joined #ceph
[20:29] * bkopilov (~bkopilov@bzq-79-180-153-78.red.bezeqint.net) Quit (Ping timeout: 480 seconds)
[20:30] * MentalRay (~MRay@MTRLPQ42-1176054809.sdsl.bell.ca) Quit (Quit: This computer has gone to sleep)
[20:31] <dschneller> We are playing around with some ideas while waiting for the backfill.
[20:31] * rotbeard (~redbeard@x5f74e5dc.dyn.telefonica.de) Quit (Quit: Leaving)
[20:31] * jclm (~jclm@ip24-253-45-236.lv.lv.cox.net) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * ebeerman (~ebeerman@64.202.160.88) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * Elwell (~elwell@106-68-39-223.dyn.iinet.net.au) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * reed (~reed@75-101-54-131.dsl.static.fusionbroadband.com) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * bene (~ben@c-24-60-237-191.hsd1.nh.comcast.net) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * smerz (~ircircirc@37.74.194.90) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * Be-El (~quassel@fb08-bcf-pc01.computational.bio.uni-giessen.de) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * ianco (~ianco@r2.iancoffey.com) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * sage (~quassel@2607:f298:6050:709d:cc6e:4e2c:d970:fa51) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * dustinm` (~dustinm`@105.ip-167-114-152.net) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * m0zes (~mozes@beocat.cis.ksu.edu) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * Xiol (~Xiol@shrike.daneelwell.eu) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * joshd (~jdurgin@206.169.83.146) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * dougf (~dougf@96-38-99-179.dhcp.jcsn.tn.charter.com) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * MK_FG (~MK_FG@00018720.user.oftc.net) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * silvrax (~silvrax@wilson.xs4all.nl) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * eqhmcow (~eqhmcow@75.177.128.160) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * ToM- (~tom@85.188.1.168) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * Bosse (~bosse@2a03:b0c0:2:d0::3:1001) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * arx (~arx@sniff-the.kittypla.net) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * spudly (~spudly@beaker.murf.org) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * georgem (~Adium@fwnat.oicr.on.ca) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * ircolle (~Adium@2601:1:a580:1735:85b0:e558:fa8:e21d) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * colonD (~colonD@173-165-224-105-minnesota.hfc.comcastbusiness.net) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * BranchPredictor (branch@predictor.org.pl) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * ktdreyer (~kdreyer@polyp.adiemus.org) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * mdxi (~mdxi@50-199-109-154-static.hfc.comcastbusiness.net) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * Kingrat (~shiny@2605:a000:1607:4000:f1a6:6113:f1b8:9f34) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * elder (~elder@c-24-245-18-91.hsd1.mn.comcast.net) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * chasmo77 (~chas77@158.183-62-69.ftth.swbr.surewest.net) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * joao (~joao@249.38.136.95.rev.vodafone.pt) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * hflai_ (hflai@alumni.cs.nctu.edu.tw) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * funnel (~funnel@0001c7d4.user.oftc.net) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * tom__ (~tom@167.88.45.146) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * Meths (~meths@2.27.78.187) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * _robbat21irssi (nobody@www2.orbis-terrarum.net) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * _nick (~nick@zarquon.dischord.org) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * ron-slc (~Ron@173-165-129-125-utah.hfc.comcastbusiness.net) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * nolan (~nolan@2001:470:1:41:a800:ff:fe3e:ad08) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * fretb (frederik@november.openminds.be) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * Tetard (~regnauld@x1.x0.dk) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * KindOne (kindone@0001a7db.user.oftc.net) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * Tene (~tene@173.13.139.236) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * palmeida (~palmeida@gandalf.wire-consulting.com) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * a1-away (~jelle@62.27.85.48) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * zz_hitsumabushi (~hitsumabu@175.184.30.148) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * stj (~stj@2604:a880:800:10::2cc:b001) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * sbadia (~sbadia@marcellin.sebian.fr) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * boolman (boolman@79.138.78.238) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * xrsanet (~nop@dev.xrsa.net) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * alexbligh1 (~alexbligh@89-16-176-215.no-reverse-dns-set.bytemark.co.uk) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * supay (sid47179@id-47179.uxbridge.irccloud.com) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * snerd (~motk@2600:3c00::f03c:91ff:fedb:2295) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * blueskin_ (~a@ks28333.kimsufi.com) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * jeffhung (~jeffhung@60-250-103-120.HINET-IP.hinet.net) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * marrusl (~mark@cpe-24-90-46-248.nyc.res.rr.com) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * pvh_sa_ (~pvh@105-236-14-252.access.mtnbusiness.co.za) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * MACscr (~Adium@2601:d:c800:de3:30f7:6d93:6a03:5aec) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * yghannam (~yghannam@0001f8aa.user.oftc.net) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * lpabon (~quassel@24-151-54-34.dhcp.nwtn.ct.charter.com) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * mjevans (~mjevans@li984-246.members.linode.com) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * Nats_ (~natscogs@114.31.195.238) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * wer (~wer@206-248-239-142.unassigned.ntelos.net) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * ccourtau- (~ccourtaut@2001:41d0:1:eed3::1) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * Administrator_ (~Administr@172.245.26.218) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * CapnBB_away (~jog@nat.mrc-lmb.cam.ac.uk) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * theanalyst (theanalyst@open.source.rocks.my.socks.firrre.com) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * sadbox (~jmcguire@sadbox.org) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * danderson (~dave@atlas.natulte.net) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * pmatulis (~peter@ec2-23-23-42-7.compute-1.amazonaws.com) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * getzburg (sid24913@id-24913.charlton.irccloud.com) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * Georgyo (~georgyo@shamm.as) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * jgornick_ (~jgornick@2600:3c00::f03c:91ff:fedf:72b4) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * florz (nobody@2001:1a50:503c::2) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * raso (~raso@deb-multimedia.org) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * JarekO (~jowsie@hC35A6AF2.cli.nitronet.pl) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * scuttlemonkey (~scuttle@nat-pool-rdu-t.redhat.com) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * _are_ (~quassel@2a01:238:4325:ca00:f065:c93c:f967:9285) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * dostrow (~dostrow@bunker.bloodmagic.com) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * seapasulli (~seapasull@95.85.33.150) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * espeer (~quassel@phobos.isoho.st) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * kuroneko (~kuroneko@2600:3c01::f03c:91ff:fe96:1bfe) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * zigo (~quassel@gplhost-3-pt.tunnel.tserv18.fra1.ipv6.he.net) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * blahnana (~bman@2602:ffe8:200:1::6019:93b3) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * dmsimard (~dmsimard@198.72.123.202) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * rkeene (1011@oc9.org) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * cephalobot (~ceph@ds3553.dreamservers.com) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * j^2 (~sid14252@id-14252.brockwell.irccloud.com) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * Archeron (~wade@wk.ws.ok.ubc.ca) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * jnq (~jnq@0001b7cc.user.oftc.net) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * skullone (~skullone@shell.skull-tech.com) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * ZyTer (~ZyTer@ghostbusters.apinnet.fr) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * skorgu (skorgu@pylon.skorgu.net) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * garphy`aw (~garphy@frank.zone84.net) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * infinity_ (~brendon@web2.artsopolis.com) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * rturk-aw` (~rturk@ds3553.dreamservers.com) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * dwm (~dwm@northrend.tastycake.net) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * philips (~philips@ec2-54-196-103-51.compute-1.amazonaws.com) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * toabctl (~toabctl@toabctl.de) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * rektide (~rektide@eldergods.com) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * Vivek (~vivek@0001171f.user.oftc.net) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * derjohn_mob (~aj@x590c15ac.dyn.telefonica.de) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * pdrakewe_ (~pdrakeweb@cpe-65-185-74-239.neo.res.rr.com) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * visbits (~textual@8.29.138.28) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * rlrevell (~leer@vbo1.inmotionhosting.com) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * jdillaman (~jdillaman@pool-173-66-110-250.washdc.fios.verizon.net) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * nhm (~nhm@184-97-175-198.mpls.qwest.net) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * leseb_ (~leseb@81-64-215-19.rev.numericable.fr) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * boichev (~boichev@213.169.56.130) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * tserong (~tserong@203-214-92-220.dyn.iinet.net.au) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * evilrob00 (~evilrob00@cpe-72-179-3-209.austin.res.rr.com) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * lkoranda (~lkoranda@nat-pool-brq-t.redhat.com) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * lbarfield (~logan@ralvm.saturne.in) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * trociny (~mgolub@93.183.239.2) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * ingard (~cake@tu.rd.vc) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * ccourtaut_ (~ccourtaut@178.62.125.124) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * Jahkeup (Jahkeup@gemini.ca.us.panicbnc.net) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * terje (~root@135.109.216.239) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * kklimonda (~kklimonda@ns331445.ip-37-187-121.eu) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * tmh_ (~e@loophole.cc) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * s3an2_ (~sean@korn.s3an.me.uk) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * Kralian-1835 (~amd@not.7f.dk) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * darkfader (~floh@88.79.251.60) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * steveeJ (~steveeJ@virthost3.stefanjunker.de) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * huats (~quassel@stuart.objectif-libre.com) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * alfredodeza (~alfredode@198.206.133.89) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * maurosr (~maurosr_@bi-03pt2.bluebird.ibm.com) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * psiekl (psiekl@wombat.eu.org) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * hchen (~hchen@nat-pool-bos-t.redhat.com) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * beardo (~beardo__@beardo.cc.lehigh.edu) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * JoeJulian (~JoeJulian@shared.gaealink.net) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * acaos (~zac@209.99.103.42) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * cetex (~oskar@nadine.juza.se) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * bro_ (~flybyhigh@panik.darksystem.net) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * gleam (gleam@dolph.debacle.org) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * trond (~trond@evil-server.alseth.info) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * `10 (~10@69.169.91.14) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * cce (~cce@50.56.54.167) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * carter (~carter@li98-136.members.linode.com) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * nwat (~nwat@kyoto.soe.ucsc.edu) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * fam (~famz@nat-pool-bos-t.redhat.com) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * HauM1 (~HauM1@login.univie.ac.at) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * MaZ- (~maz@00016955.user.oftc.net) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * kraken (~kraken@gw.sepia.ceph.com) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * ctd (~root@00011932.user.oftc.net) Quit (charon.oftc.net resistance.oftc.net)
[20:31] * cephiroth (~oftc-webi@br167-098.ifremer.fr) Quit (charon.oftc.net resistance.oftc.net)
[20:31] <dschneller> As both problematic OSDs are marked out, would it impact the ongoing backfill to bring it up again? Just to see if it boots up.
[20:32] <dschneller> Be-el: As both problematic OSDs are marked out, would it impact the ongoing backfill to bring it up again? Just to see if it boots up.
[20:32] * daniel2_ (~dshafer@0001b605.user.oftc.net) Quit (Remote host closed the connection)
[20:33] * Elwell (~elwell@58-7-146-234.dyn.iinet.net.au) has joined #ceph
[20:38] * Elwell (~elwell@58-7-146-234.dyn.iinet.net.au) Quit (Killed (synthon.oftc.net (Nick collision (new))))
[20:39] * derjohn_mob (~aj@x590c15ac.dyn.telefonica.de) has joined #ceph
[20:39] * jclm (~jclm@ip24-253-45-236.lv.lv.cox.net) has joined #ceph
[20:39] * pdrakewe_ (~pdrakeweb@cpe-65-185-74-239.neo.res.rr.com) has joined #ceph
[20:39] * marrusl (~mark@cpe-24-90-46-248.nyc.res.rr.com) has joined #ceph
[20:39] * ebeerman (~ebeerman@64.202.160.88) has joined #ceph
[20:39] * Elwell (~elwell@106-68-39-223.dyn.iinet.net.au) has joined #ceph
[20:39] * pvh_sa_ (~pvh@105-236-14-252.access.mtnbusiness.co.za) has joined #ceph
[20:39] * reed (~reed@75-101-54-131.dsl.static.fusionbroadband.com) has joined #ceph
[20:39] * visbits (~textual@8.29.138.28) has joined #ceph
[20:39] * MACscr (~Adium@2601:d:c800:de3:30f7:6d93:6a03:5aec) has joined #ceph
[20:39] * yghannam (~yghannam@0001f8aa.user.oftc.net) has joined #ceph
[20:39] * lpabon (~quassel@24-151-54-34.dhcp.nwtn.ct.charter.com) has joined #ceph
[20:39] * georgem (~Adium@fwnat.oicr.on.ca) has joined #ceph
[20:39] * rlrevell (~leer@vbo1.inmotionhosting.com) has joined #ceph
[20:39] * bene (~ben@c-24-60-237-191.hsd1.nh.comcast.net) has joined #ceph
[20:39] * jdillaman (~jdillaman@pool-173-66-110-250.washdc.fios.verizon.net) has joined #ceph
[20:39] * smerz (~ircircirc@37.74.194.90) has joined #ceph
[20:39] * Be-El (~quassel@fb08-bcf-pc01.computational.bio.uni-giessen.de) has joined #ceph
[20:39] * snerd (~motk@2600:3c00::f03c:91ff:fedb:2295) has joined #ceph
[20:39] * ianco (~ianco@r2.iancoffey.com) has joined #ceph
[20:39] * sage (~quassel@2607:f298:6050:709d:cc6e:4e2c:d970:fa51) has joined #ceph
[20:39] * dustinm` (~dustinm`@105.ip-167-114-152.net) has joined #ceph
[20:39] * nhm (~nhm@184-97-175-198.mpls.qwest.net) has joined #ceph
[20:39] * ircolle (~Adium@2601:1:a580:1735:85b0:e558:fa8:e21d) has joined #ceph
[20:39] * alfredodeza (~alfredode@198.206.133.89) has joined #ceph
[20:39] * m0zes (~mozes@beocat.cis.ksu.edu) has joined #ceph
[20:39] * colonD (~colonD@173-165-224-105-minnesota.hfc.comcastbusiness.net) has joined #ceph
[20:39] * cephiroth (~oftc-webi@br167-098.ifremer.fr) has joined #ceph
[20:39] * Xiol (~Xiol@shrike.daneelwell.eu) has joined #ceph
[20:39] * joshd (~jdurgin@206.169.83.146) has joined #ceph
[20:39] * dougf (~dougf@96-38-99-179.dhcp.jcsn.tn.charter.com) has joined #ceph
[20:39] * MK_FG (~MK_FG@00018720.user.oftc.net) has joined #ceph
[20:39] * mjevans (~mjevans@li984-246.members.linode.com) has joined #ceph
[20:39] * leseb_ (~leseb@81-64-215-19.rev.numericable.fr) has joined #ceph
[20:39] * boichev (~boichev@213.169.56.130) has joined #ceph
[20:39] * Nats_ (~natscogs@114.31.195.238) has joined #ceph
[20:39] * silvrax (~silvrax@wilson.xs4all.nl) has joined #ceph
[20:39] * tserong (~tserong@203-214-92-220.dyn.iinet.net.au) has joined #ceph
[20:39] * eqhmcow (~eqhmcow@75.177.128.160) has joined #ceph
[20:39] * ToM- (~tom@85.188.1.168) has joined #ceph
[20:39] * ccourtau- (~ccourtaut@2001:41d0:1:eed3::1) has joined #ceph
[20:39] * Bosse (~bosse@2a03:b0c0:2:d0::3:1001) has joined #ceph
[20:39] * wer (~wer@206-248-239-142.unassigned.ntelos.net) has joined #ceph
[20:39] * BranchPredictor (branch@predictor.org.pl) has joined #ceph
[20:39] * arx (~arx@sniff-the.kittypla.net) has joined #ceph
[20:39] * ktdreyer (~kdreyer@polyp.adiemus.org) has joined #ceph
[20:39] * mdxi (~mdxi@50-199-109-154-static.hfc.comcastbusiness.net) has joined #ceph
[20:39] * spudly (~spudly@beaker.murf.org) has joined #ceph
[20:39] * Kingrat (~shiny@2605:a000:1607:4000:f1a6:6113:f1b8:9f34) has joined #ceph
[20:39] * Administrator_ (~Administr@172.245.26.218) has joined #ceph
[20:39] * elder (~elder@c-24-245-18-91.hsd1.mn.comcast.net) has joined #ceph
[20:39] * chasmo77 (~chas77@158.183-62-69.ftth.swbr.surewest.net) has joined #ceph
[20:39] * CapnBB_away (~jog@nat.mrc-lmb.cam.ac.uk) has joined #ceph
[20:39] * joao (~joao@249.38.136.95.rev.vodafone.pt) has joined #ceph
[20:39] * hflai_ (hflai@alumni.cs.nctu.edu.tw) has joined #ceph
[20:39] * funnel (~funnel@0001c7d4.user.oftc.net) has joined #ceph
[20:39] * tom__ (~tom@167.88.45.146) has joined #ceph
[20:39] * theanalyst (theanalyst@open.source.rocks.my.socks.firrre.com) has joined #ceph
[20:39] * Meths (~meths@2.27.78.187) has joined #ceph
[20:39] * evilrob00 (~evilrob00@cpe-72-179-3-209.austin.res.rr.com) has joined #ceph
[20:39] * _robbat21irssi (nobody@www2.orbis-terrarum.net) has joined #ceph
[20:39] * lkoranda (~lkoranda@nat-pool-brq-t.redhat.com) has joined #ceph
[20:39] * _nick (~nick@zarquon.dischord.org) has joined #ceph
[20:39] * maurosr (~maurosr_@bi-03pt2.bluebird.ibm.com) has joined #ceph
[20:39] * sadbox (~jmcguire@sadbox.org) has joined #ceph
[20:39] * ron-slc (~Ron@173-165-129-125-utah.hfc.comcastbusiness.net) has joined #ceph
[20:39] * nolan (~nolan@2001:470:1:41:a800:ff:fe3e:ad08) has joined #ceph
[20:39] * lbarfield (~logan@ralvm.saturne.in) has joined #ceph
[20:39] * trociny (~mgolub@93.183.239.2) has joined #ceph
[20:39] * fretb (frederik@november.openminds.be) has joined #ceph
[20:39] * Tetard (~regnauld@x1.x0.dk) has joined #ceph
[20:39] * danderson (~dave@atlas.natulte.net) has joined #ceph
[20:39] * KindOne (kindone@0001a7db.user.oftc.net) has joined #ceph
[20:39] * Tene (~tene@173.13.139.236) has joined #ceph
[20:39] * palmeida (~palmeida@gandalf.wire-consulting.com) has joined #ceph
[20:39] * a1-away (~jelle@62.27.85.48) has joined #ceph
[20:39] * zz_hitsumabushi (~hitsumabu@175.184.30.148) has joined #ceph
[20:39] * stj (~stj@2604:a880:800:10::2cc:b001) has joined #ceph
[20:39] * sbadia (~sbadia@marcellin.sebian.fr) has joined #ceph
[20:39] * boolman (boolman@79.138.78.238) has joined #ceph
[20:39] * xrsanet (~nop@dev.xrsa.net) has joined #ceph
[20:39] * alexbligh1 (~alexbligh@89-16-176-215.no-reverse-dns-set.bytemark.co.uk) has joined #ceph
[20:39] * ingard (~cake@tu.rd.vc) has joined #ceph
[20:39] * pmatulis (~peter@ec2-23-23-42-7.compute-1.amazonaws.com) has joined #ceph
[20:39] * ccourtaut_ (~ccourtaut@178.62.125.124) has joined #ceph
[20:39] * supay (sid47179@id-47179.uxbridge.irccloud.com) has joined #ceph
[20:39] * getzburg (sid24913@id-24913.charlton.irccloud.com) has joined #ceph
[20:39] * blueskin_ (~a@ks28333.kimsufi.com) has joined #ceph
[20:39] * jeffhung (~jeffhung@60-250-103-120.HINET-IP.hinet.net) has joined #ceph
[20:39] * Jahkeup (Jahkeup@gemini.ca.us.panicbnc.net) has joined #ceph
[20:39] * terje (~root@135.109.216.239) has joined #ceph
[20:39] * Georgyo (~georgyo@shamm.as) has joined #ceph
[20:39] * jgornick_ (~jgornick@2600:3c00::f03c:91ff:fedf:72b4) has joined #ceph
[20:39] * kklimonda (~kklimonda@ns331445.ip-37-187-121.eu) has joined #ceph
[20:39] * tmh_ (~e@loophole.cc) has joined #ceph
[20:39] * florz (nobody@2001:1a50:503c::2) has joined #ceph
[20:39] * raso (~raso@deb-multimedia.org) has joined #ceph
[20:39] * s3an2_ (~sean@korn.s3an.me.uk) has joined #ceph
[20:39] * Kralian-1835 (~amd@not.7f.dk) has joined #ceph
[20:39] * darkfader (~floh@88.79.251.60) has joined #ceph
[20:39] * steveeJ (~steveeJ@virthost3.stefanjunker.de) has joined #ceph
[20:39] * JarekO (~jowsie@hC35A6AF2.cli.nitronet.pl) has joined #ceph
[20:39] * huats (~quassel@stuart.objectif-libre.com) has joined #ceph
[20:39] * scuttlemonkey (~scuttle@nat-pool-rdu-t.redhat.com) has joined #ceph
[20:39] * _are_ (~quassel@2a01:238:4325:ca00:f065:c93c:f967:9285) has joined #ceph
[20:39] * dostrow (~dostrow@bunker.bloodmagic.com) has joined #ceph
[20:39] * skullone (~skullone@shell.skull-tech.com) has joined #ceph
[20:39] * hchen (~hchen@nat-pool-bos-t.redhat.com) has joined #ceph
[20:39] * seapasulli (~seapasull@95.85.33.150) has joined #ceph
[20:39] * rkeene (1011@oc9.org) has joined #ceph
[20:39] * espeer (~quassel@phobos.isoho.st) has joined #ceph
[20:39] * psiekl (psiekl@wombat.eu.org) has joined #ceph
[20:39] * kuroneko (~kuroneko@2600:3c01::f03c:91ff:fe96:1bfe) has joined #ceph
[20:39] * zigo (~quassel@gplhost-3-pt.tunnel.tserv18.fra1.ipv6.he.net) has joined #ceph
[20:39] * blahnana (~bman@2602:ffe8:200:1::6019:93b3) has joined #ceph
[20:39] * dmsimard (~dmsimard@198.72.123.202) has joined #ceph
[20:39] * cephalobot (~ceph@ds3553.dreamservers.com) has joined #ceph
[20:39] * j^2 (~sid14252@id-14252.brockwell.irccloud.com) has joined #ceph
[20:39] * Archeron (~wade@wk.ws.ok.ubc.ca) has joined #ceph
[20:39] * jnq (~jnq@0001b7cc.user.oftc.net) has joined #ceph
[20:39] * rturk-aw` (~rturk@ds3553.dreamservers.com) has joined #ceph
[20:39] * dwm (~dwm@northrend.tastycake.net) has joined #ceph
[20:39] * Vivek (~vivek@0001171f.user.oftc.net) has joined #ceph
[20:39] * ZyTer (~ZyTer@ghostbusters.apinnet.fr) has joined #ceph
[20:39] * skorgu (skorgu@pylon.skorgu.net) has joined #ceph
[20:39] * philips (~philips@ec2-54-196-103-51.compute-1.amazonaws.com) has joined #ceph
[20:39] * garphy`aw (~garphy@frank.zone84.net) has joined #ceph
[20:39] * toabctl (~toabctl@toabctl.de) has joined #ceph
[20:39] * rektide (~rektide@eldergods.com) has joined #ceph
[20:39] * infinity_ (~brendon@web2.artsopolis.com) has joined #ceph
[20:39] * beardo (~beardo__@beardo.cc.lehigh.edu) has joined #ceph
[20:39] * JoeJulian (~JoeJulian@shared.gaealink.net) has joined #ceph
[20:39] * acaos (~zac@209.99.103.42) has joined #ceph
[20:39] * cetex (~oskar@nadine.juza.se) has joined #ceph
[20:39] * bro_ (~flybyhigh@panik.darksystem.net) has joined #ceph
[20:39] * fam (~famz@nat-pool-bos-t.redhat.com) has joined #ceph
[20:39] * MaZ- (~maz@00016955.user.oftc.net) has joined #ceph
[20:39] * gleam (gleam@dolph.debacle.org) has joined #ceph
[20:39] * trond (~trond@evil-server.alseth.info) has joined #ceph
[20:39] * carter (~carter@li98-136.members.linode.com) has joined #ceph
[20:39] * `10 (~10@69.169.91.14) has joined #ceph
[20:39] * cce (~cce@50.56.54.167) has joined #ceph
[20:39] * kraken (~kraken@gw.sepia.ceph.com) has joined #ceph
[20:39] * ctd (~root@00011932.user.oftc.net) has joined #ceph
[20:39] * nwat (~nwat@kyoto.soe.ucsc.edu) has joined #ceph
[20:39] * HauM1 (~HauM1@login.univie.ac.at) has joined #ceph
[20:39] * ChanServ sets mode +v sage
[20:39] * ChanServ sets mode +v nhm
[20:39] * ChanServ sets mode +o ircolle
[20:39] * ChanServ sets mode +v elder
[20:39] * ChanServ sets mode +v joao
[20:39] * ChanServ sets mode +o scuttlemonkey
[20:39] * Elwell_ (~elwell@58-7-146-234.dyn.iinet.net.au) has joined #ceph
[20:39] * cce (~cce@50.56.54.167) Quit (resistance.oftc.net larich.oftc.net)
[20:39] * `10 (~10@69.169.91.14) Quit (resistance.oftc.net larich.oftc.net)
[20:39] * trond (~trond@evil-server.alseth.info) Quit (resistance.oftc.net larich.oftc.net)
[20:39] * gleam (gleam@dolph.debacle.org) Quit (resistance.oftc.net larich.oftc.net)
[20:39] * bro_ (~flybyhigh@panik.darksystem.net) Quit (resistance.oftc.net larich.oftc.net)
[20:39] * cetex (~oskar@nadine.juza.se) Quit (resistance.oftc.net larich.oftc.net)
[20:39] * acaos (~zac@209.99.103.42) Quit (resistance.oftc.net larich.oftc.net)
[20:39] * JoeJulian (~JoeJulian@shared.gaealink.net) Quit (resistance.oftc.net larich.oftc.net)
[20:39] * beardo (~beardo__@beardo.cc.lehigh.edu) Quit (resistance.oftc.net larich.oftc.net)
[20:39] * psiekl (psiekl@wombat.eu.org) Quit (resistance.oftc.net larich.oftc.net)
[20:39] * hchen (~hchen@nat-pool-bos-t.redhat.com) Quit (resistance.oftc.net larich.oftc.net)
[20:39] * huats (~quassel@stuart.objectif-libre.com) Quit (resistance.oftc.net larich.oftc.net)
[20:39] * steveeJ (~steveeJ@virthost3.stefanjunker.de) Quit (resistance.oftc.net larich.oftc.net)
[20:39] * darkfader (~floh@88.79.251.60) Quit (resistance.oftc.net larich.oftc.net)
[20:39] * s3an2_ (~sean@korn.s3an.me.uk) Quit (resistance.oftc.net larich.oftc.net)
[20:39] * kklimonda (~kklimonda@ns331445.ip-37-187-121.eu) Quit (resistance.oftc.net larich.oftc.net)
[20:39] * terje (~root@135.109.216.239) Quit (resistance.oftc.net larich.oftc.net)
[20:39] * Jahkeup (Jahkeup@gemini.ca.us.panicbnc.net) Quit (resistance.oftc.net larich.oftc.net)
[20:39] * maurosr (~maurosr_@bi-03pt2.bluebird.ibm.com) Quit (resistance.oftc.net larich.oftc.net)
[20:39] * evilrob00 (~evilrob00@cpe-72-179-3-209.austin.res.rr.com) Quit (resistance.oftc.net larich.oftc.net)
[20:39] * boichev (~boichev@213.169.56.130) Quit (resistance.oftc.net larich.oftc.net)
[20:39] * rlrevell (~leer@vbo1.inmotionhosting.com) Quit (resistance.oftc.net larich.oftc.net)
[20:39] * visbits (~textual@8.29.138.28) Quit (resistance.oftc.net larich.oftc.net)
[20:39] * Kralian-1835 (~amd@not.7f.dk) Quit (resistance.oftc.net larich.oftc.net)
[20:39] * derjohn_mob (~aj@x590c15ac.dyn.telefonica.de) Quit (resistance.oftc.net larich.oftc.net)
[20:39] * nwat (~nwat@kyoto.soe.ucsc.edu) Quit (resistance.oftc.net larich.oftc.net)
[20:39] * carter (~carter@li98-136.members.linode.com) Quit (resistance.oftc.net larich.oftc.net)
[20:39] * alfredodeza (~alfredode@198.206.133.89) Quit (resistance.oftc.net larich.oftc.net)
[20:39] * ccourtaut_ (~ccourtaut@178.62.125.124) Quit (resistance.oftc.net larich.oftc.net)
[20:39] * ingard (~cake@tu.rd.vc) Quit (resistance.oftc.net larich.oftc.net)
[20:39] * trociny (~mgolub@93.183.239.2) Quit (resistance.oftc.net larich.oftc.net)
[20:39] * lbarfield (~logan@ralvm.saturne.in) Quit (resistance.oftc.net larich.oftc.net)
[20:39] * lkoranda (~lkoranda@nat-pool-brq-t.redhat.com) Quit (resistance.oftc.net larich.oftc.net)
[20:39] * nhm (~nhm@184-97-175-198.mpls.qwest.net) Quit (resistance.oftc.net larich.oftc.net)
[20:39] * jdillaman (~jdillaman@pool-173-66-110-250.washdc.fios.verizon.net) Quit (resistance.oftc.net larich.oftc.net)
[20:39] * pdrakewe_ (~pdrakeweb@cpe-65-185-74-239.neo.res.rr.com) Quit (resistance.oftc.net larich.oftc.net)
[20:39] * tserong (~tserong@203-214-92-220.dyn.iinet.net.au) Quit (resistance.oftc.net larich.oftc.net)
[20:39] * fam (~famz@nat-pool-bos-t.redhat.com) Quit (resistance.oftc.net larich.oftc.net)
[20:39] * ctd (~root@00011932.user.oftc.net) Quit (resistance.oftc.net larich.oftc.net)
[20:39] * MaZ- (~maz@00016955.user.oftc.net) Quit (resistance.oftc.net larich.oftc.net)
[20:39] * HauM1 (~HauM1@login.univie.ac.at) Quit (resistance.oftc.net larich.oftc.net)
[20:39] * kraken (~kraken@gw.sepia.ceph.com) Quit (resistance.oftc.net larich.oftc.net)
[20:39] * tmh_ (~e@loophole.cc) Quit (resistance.oftc.net larich.oftc.net)
[20:39] * leseb_ (~leseb@81-64-215-19.rev.numericable.fr) Quit (resistance.oftc.net larich.oftc.net)
[20:39] * jeffhung (~jeffhung@60-250-103-120.HINET-IP.hinet.net) Quit (resistance.oftc.net weber.oftc.net)
[20:39] * blueskin_ (~a@ks28333.kimsufi.com) Quit (resistance.oftc.net weber.oftc.net)
[20:39] * alexbligh1 (~alexbligh@89-16-176-215.no-reverse-dns-set.bytemark.co.uk) Quit (resistance.oftc.net weber.oftc.net)
[20:39] * boolman (boolman@79.138.78.238) Quit (resistance.oftc.net weber.oftc.net)
[20:39] * stj (~stj@2604:a880:800:10::2cc:b001) Quit (resistance.oftc.net weber.oftc.net)
[20:39] * palmeida (~palmeida@gandalf.wire-consulting.com) Quit (resistance.oftc.net weber.oftc.net)
[20:39] * Tene (~tene@173.13.139.236) Quit (resistance.oftc.net weber.oftc.net)
[20:39] * fretb (frederik@november.openminds.be) Quit (resistance.oftc.net weber.oftc.net)
[20:39] * ron-slc (~Ron@173-165-129-125-utah.hfc.comcastbusiness.net) Quit (resistance.oftc.net weber.oftc.net)
[20:39] * _nick (~nick@zarquon.dischord.org) Quit (resistance.oftc.net weber.oftc.net)
[20:39] * _robbat21irssi (nobody@www2.orbis-terrarum.net) Quit (resistance.oftc.net weber.oftc.net)
[20:39] * Meths (~meths@2.27.78.187) Quit (resistance.oftc.net weber.oftc.net)
[20:39] * hflai_ (hflai@alumni.cs.nctu.edu.tw) Quit (resistance.oftc.net weber.oftc.net)
[20:39] * Kingrat (~shiny@2605:a000:1607:4000:f1a6:6113:f1b8:9f34) Quit (resistance.oftc.net weber.oftc.net)
[20:39] * mdxi (~mdxi@50-199-109-154-static.hfc.comcastbusiness.net) Quit (resistance.oftc.net weber.oftc.net)
[20:39] * colonD (~colonD@173-165-224-105-minnesota.hfc.comcastbusiness.net) Quit (resistance.oftc.net weber.oftc.net)
[20:39] * snerd (~motk@2600:3c00::f03c:91ff:fedb:2295) Quit (resistance.oftc.net weber.oftc.net)
[20:39] * georgem (~Adium@fwnat.oicr.on.ca) Quit (resistance.oftc.net weber.oftc.net)
[20:39] * Tetard (~regnauld@x1.x0.dk) Quit (resistance.oftc.net weber.oftc.net)
[20:39] * xrsanet (~nop@dev.xrsa.net) Quit (resistance.oftc.net weber.oftc.net)
[20:39] * nolan (~nolan@2001:470:1:41:a800:ff:fe3e:ad08) Quit (resistance.oftc.net weber.oftc.net)
[20:39] * chasmo77 (~chas77@158.183-62-69.ftth.swbr.surewest.net) Quit (resistance.oftc.net weber.oftc.net)
[20:39] * supay (sid47179@id-47179.uxbridge.irccloud.com) Quit (resistance.oftc.net weber.oftc.net)
[20:39] * tom__ (~tom@167.88.45.146) Quit (resistance.oftc.net weber.oftc.net)
[20:39] * joao (~joao@249.38.136.95.rev.vodafone.pt) Quit (resistance.oftc.net weber.oftc.net)
[20:39] * elder (~elder@c-24-245-18-91.hsd1.mn.comcast.net) Quit (resistance.oftc.net weber.oftc.net)
[20:39] * ktdreyer (~kdreyer@polyp.adiemus.org) Quit (resistance.oftc.net weber.oftc.net)
[20:39] * BranchPredictor (branch@predictor.org.pl) Quit (resistance.oftc.net weber.oftc.net)
[20:39] * ircolle (~Adium@2601:1:a580:1735:85b0:e558:fa8:e21d) Quit (resistance.oftc.net weber.oftc.net)
[20:39] * a1-away (~jelle@62.27.85.48) Quit (resistance.oftc.net weber.oftc.net)
[20:39] * zz_hitsumabushi (~hitsumabu@175.184.30.148) Quit (resistance.oftc.net weber.oftc.net)
[20:39] * KindOne (kindone@0001a7db.user.oftc.net) Quit (resistance.oftc.net weber.oftc.net)
[20:39] * sbadia (~sbadia@marcellin.sebian.fr) Quit (resistance.oftc.net weber.oftc.net)
[20:39] * funnel (~funnel@0001c7d4.user.oftc.net) Quit (resistance.oftc.net weber.oftc.net)
[20:39] * Elwell (~elwell@106-68-39-223.dyn.iinet.net.au) Quit (Ping timeout: 480 seconds)
[20:39] * infinity_ (~brendon@web2.artsopolis.com) Quit (resistance.oftc.net charm.oftc.net)
[20:39] * garphy`aw (~garphy@frank.zone84.net) Quit (resistance.oftc.net charm.oftc.net)
[20:39] * skorgu (skorgu@pylon.skorgu.net) Quit (resistance.oftc.net charm.oftc.net)
[20:39] * ZyTer (~ZyTer@ghostbusters.apinnet.fr) Quit (resistance.oftc.net charm.oftc.net)
[20:39] * rturk-aw` (~rturk@ds3553.dreamservers.com) Quit (resistance.oftc.net charm.oftc.net)
[20:39] * jnq (~jnq@0001b7cc.user.oftc.net) Quit (resistance.oftc.net charm.oftc.net)
[20:39] * Archeron (~wade@wk.ws.ok.ubc.ca) Quit (resistance.oftc.net charm.oftc.net)
[20:39] * blahnana (~bman@2602:ffe8:200:1::6019:93b3) Quit (resistance.oftc.net charm.oftc.net)
[20:39] * rkeene (1011@oc9.org) Quit (resistance.oftc.net charm.oftc.net)
[20:39] * seapasulli (~seapasull@95.85.33.150) Quit (resistance.oftc.net charm.oftc.net)
[20:39] * skullone (~skullone@shell.skull-tech.com) Quit (resistance.oftc.net charm.oftc.net)
[20:39] * dostrow (~dostrow@bunker.bloodmagic.com) Quit (resistance.oftc.net charm.oftc.net)
[20:39] * JarekO (~jowsie@hC35A6AF2.cli.nitronet.pl) Quit (resistance.oftc.net charm.oftc.net)
[20:39] * getzburg (sid24913@id-24913.charlton.irccloud.com) Quit (resistance.oftc.net charm.oftc.net)
[20:39] * pmatulis (~peter@ec2-23-23-42-7.compute-1.amazonaws.com) Quit (resistance.oftc.net charm.oftc.net)
[20:39] * danderson (~dave@atlas.natulte.net) Quit (resistance.oftc.net charm.oftc.net)
[20:39] * CapnBB_away (~jog@nat.mrc-lmb.cam.ac.uk) Quit (resistance.oftc.net charm.oftc.net)
[20:39] * Administrator_ (~Administr@172.245.26.218) Quit (resistance.oftc.net charm.oftc.net)
[20:39] * wer (~wer@206-248-239-142.unassigned.ntelos.net) Quit (resistance.oftc.net charm.oftc.net)
[20:39] * ccourtau- (~ccourtaut@2001:41d0:1:eed3::1) Quit (resistance.oftc.net charm.oftc.net)
[20:39] * MACscr (~Adium@2601:d:c800:de3:30f7:6d93:6a03:5aec) Quit (resistance.oftc.net charm.oftc.net)
[20:39] * pvh_sa_ (~pvh@105-236-14-252.access.mtnbusiness.co.za) Quit (resistance.oftc.net charm.oftc.net)
[20:39] * jgornick_ (~jgornick@2600:3c00::f03c:91ff:fedf:72b4) Quit (resistance.oftc.net charm.oftc.net)
[20:39] * Georgyo (~georgyo@shamm.as) Quit (resistance.oftc.net charm.oftc.net)
[20:39] * sadbox (~jmcguire@sadbox.org) Quit (resistance.oftc.net charm.oftc.net)
[20:39] * mjevans (~mjevans@li984-246.members.linode.com) Quit (resistance.oftc.net charm.oftc.net)
[20:39] * _are_ (~quassel@2a01:238:4325:ca00:f065:c93c:f967:9285) Quit (resistance.oftc.net charm.oftc.net)
[20:39] * toabctl (~toabctl@toabctl.de) Quit (resistance.oftc.net charm.oftc.net)
[20:39] * dwm (~dwm@northrend.tastycake.net) Quit (resistance.oftc.net charm.oftc.net)
[20:39] * j^2 (~sid14252@id-14252.brockwell.irccloud.com) Quit (resistance.oftc.net charm.oftc.net)
[20:39] * dmsimard (~dmsimard@198.72.123.202) Quit (resistance.oftc.net charm.oftc.net)
[20:39] * florz (nobody@2001:1a50:503c::2) Quit (resistance.oftc.net charm.oftc.net)
[20:39] * Nats_ (~natscogs@114.31.195.238) Quit (resistance.oftc.net charm.oftc.net)
[20:39] * lpabon (~quassel@24-151-54-34.dhcp.nwtn.ct.charter.com) Quit (resistance.oftc.net charm.oftc.net)
[20:39] * yghannam (~yghannam@0001f8aa.user.oftc.net) Quit (resistance.oftc.net charm.oftc.net)
[20:39] * rektide (~rektide@eldergods.com) Quit (resistance.oftc.net charm.oftc.net)
[20:39] * kuroneko (~kuroneko@2600:3c01::f03c:91ff:fe96:1bfe) Quit (resistance.oftc.net charm.oftc.net)
[20:39] * theanalyst (theanalyst@open.source.rocks.my.socks.firrre.com) Quit (resistance.oftc.net charm.oftc.net)
[20:39] * scuttlemonkey (~scuttle@nat-pool-rdu-t.redhat.com) Quit (resistance.oftc.net charm.oftc.net)
[20:39] * philips (~philips@ec2-54-196-103-51.compute-1.amazonaws.com) Quit (resistance.oftc.net charm.oftc.net)
[20:39] * marrusl (~mark@cpe-24-90-46-248.nyc.res.rr.com) Quit (resistance.oftc.net charm.oftc.net)
[20:39] * raso (~raso@deb-multimedia.org) Quit (resistance.oftc.net charm.oftc.net)
[20:39] * espeer (~quassel@phobos.isoho.st) Quit (resistance.oftc.net charm.oftc.net)
[20:39] * Vivek (~vivek@0001171f.user.oftc.net) Quit (resistance.oftc.net charm.oftc.net)
[20:39] * zigo (~quassel@gplhost-3-pt.tunnel.tserv18.fra1.ipv6.he.net) Quit (resistance.oftc.net charm.oftc.net)
[20:39] * cephalobot (~ceph@ds3553.dreamservers.com) Quit (resistance.oftc.net charm.oftc.net)
[20:40] * derjohn_mob (~aj@x590c15ac.dyn.telefonica.de) has joined #ceph
[20:40] * pdrakewe_ (~pdrakeweb@cpe-65-185-74-239.neo.res.rr.com) has joined #ceph
[20:40] * visbits (~textual@8.29.138.28) has joined #ceph
[20:40] * rlrevell (~leer@vbo1.inmotionhosting.com) has joined #ceph
[20:40] * jdillaman (~jdillaman@pool-173-66-110-250.washdc.fios.verizon.net) has joined #ceph
[20:40] * nhm (~nhm@184-97-175-198.mpls.qwest.net) has joined #ceph
[20:40] * alfredodeza (~alfredode@198.206.133.89) has joined #ceph
[20:40] * leseb_ (~leseb@81-64-215-19.rev.numericable.fr) has joined #ceph
[20:40] * boichev (~boichev@213.169.56.130) has joined #ceph
[20:40] * tserong (~tserong@203-214-92-220.dyn.iinet.net.au) has joined #ceph
[20:40] * evilrob00 (~evilrob00@cpe-72-179-3-209.austin.res.rr.com) has joined #ceph
[20:40] * lkoranda (~lkoranda@nat-pool-brq-t.redhat.com) has joined #ceph
[20:40] * maurosr (~maurosr_@bi-03pt2.bluebird.ibm.com) has joined #ceph
[20:40] * lbarfield (~logan@ralvm.saturne.in) has joined #ceph
[20:40] * trociny (~mgolub@93.183.239.2) has joined #ceph
[20:40] * ingard (~cake@tu.rd.vc) has joined #ceph
[20:40] * ccourtaut_ (~ccourtaut@178.62.125.124) has joined #ceph
[20:40] * Jahkeup (Jahkeup@gemini.ca.us.panicbnc.net) has joined #ceph
[20:40] * terje (~root@135.109.216.239) has joined #ceph
[20:40] * kklimonda (~kklimonda@ns331445.ip-37-187-121.eu) has joined #ceph
[20:40] * tmh_ (~e@loophole.cc) has joined #ceph
[20:40] * s3an2_ (~sean@korn.s3an.me.uk) has joined #ceph
[20:40] * Kralian-1835 (~amd@not.7f.dk) has joined #ceph
[20:40] * darkfader (~floh@88.79.251.60) has joined #ceph
[20:40] * steveeJ (~steveeJ@virthost3.stefanjunker.de) has joined #ceph
[20:40] * huats (~quassel@stuart.objectif-libre.com) has joined #ceph
[20:40] * hchen (~hchen@nat-pool-bos-t.redhat.com) has joined #ceph
[20:40] * psiekl (psiekl@wombat.eu.org) has joined #ceph
[20:40] * HauM1 (~HauM1@login.univie.ac.at) has joined #ceph
[20:40] * nwat (~nwat@kyoto.soe.ucsc.edu) has joined #ceph
[20:40] * ctd (~root@00011932.user.oftc.net) has joined #ceph
[20:40] * kraken (~kraken@gw.sepia.ceph.com) has joined #ceph
[20:40] * cce (~cce@50.56.54.167) has joined #ceph
[20:40] * `10 (~10@69.169.91.14) has joined #ceph
[20:40] * carter (~carter@li98-136.members.linode.com) has joined #ceph
[20:40] * trond (~trond@evil-server.alseth.info) has joined #ceph
[20:40] * gleam (gleam@dolph.debacle.org) has joined #ceph
[20:40] * MaZ- (~maz@00016955.user.oftc.net) has joined #ceph
[20:40] * fam (~famz@nat-pool-bos-t.redhat.com) has joined #ceph
[20:40] * bro_ (~flybyhigh@panik.darksystem.net) has joined #ceph
[20:40] * cetex (~oskar@nadine.juza.se) has joined #ceph
[20:40] * acaos (~zac@209.99.103.42) has joined #ceph
[20:40] * JoeJulian (~JoeJulian@shared.gaealink.net) has joined #ceph
[20:40] * beardo (~beardo__@beardo.cc.lehigh.edu) has joined #ceph
[20:40] * ChanServ sets mode +v nhm
[20:40] * marrusl (~mark@cpe-24-90-46-248.nyc.res.rr.com) has joined #ceph
[20:40] * pvh_sa_ (~pvh@105-236-14-252.access.mtnbusiness.co.za) has joined #ceph
[20:40] * MACscr (~Adium@2601:d:c800:de3:30f7:6d93:6a03:5aec) has joined #ceph
[20:40] * yghannam (~yghannam@0001f8aa.user.oftc.net) has joined #ceph
[20:40] * lpabon (~quassel@24-151-54-34.dhcp.nwtn.ct.charter.com) has joined #ceph
[20:40] * mjevans (~mjevans@li984-246.members.linode.com) has joined #ceph
[20:40] * Nats_ (~natscogs@114.31.195.238) has joined #ceph
[20:40] * ccourtau- (~ccourtaut@2001:41d0:1:eed3::1) has joined #ceph
[20:40] * wer (~wer@206-248-239-142.unassigned.ntelos.net) has joined #ceph
[20:40] * Administrator_ (~Administr@172.245.26.218) has joined #ceph
[20:40] * CapnBB_away (~jog@nat.mrc-lmb.cam.ac.uk) has joined #ceph
[20:40] * theanalyst (theanalyst@open.source.rocks.my.socks.firrre.com) has joined #ceph
[20:40] * sadbox (~jmcguire@sadbox.org) has joined #ceph
[20:40] * danderson (~dave@atlas.natulte.net) has joined #ceph
[20:40] * pmatulis (~peter@ec2-23-23-42-7.compute-1.amazonaws.com) has joined #ceph
[20:40] * getzburg (sid24913@id-24913.charlton.irccloud.com) has joined #ceph
[20:40] * Georgyo (~georgyo@shamm.as) has joined #ceph
[20:40] * jgornick_ (~jgornick@2600:3c00::f03c:91ff:fedf:72b4) has joined #ceph
[20:40] * florz (nobody@2001:1a50:503c::2) has joined #ceph
[20:40] * raso (~raso@deb-multimedia.org) has joined #ceph
[20:40] * JarekO (~jowsie@hC35A6AF2.cli.nitronet.pl) has joined #ceph
[20:40] * scuttlemonkey (~scuttle@nat-pool-rdu-t.redhat.com) has joined #ceph
[20:40] * _are_ (~quassel@2a01:238:4325:ca00:f065:c93c:f967:9285) has joined #ceph
[20:40] * dostrow (~dostrow@bunker.bloodmagic.com) has joined #ceph
[20:40] * skullone (~skullone@shell.skull-tech.com) has joined #ceph
[20:40] * seapasulli (~seapasull@95.85.33.150) has joined #ceph
[20:40] * rkeene (1011@oc9.org) has joined #ceph
[20:40] * espeer (~quassel@phobos.isoho.st) has joined #ceph
[20:40] * kuroneko (~kuroneko@2600:3c01::f03c:91ff:fe96:1bfe) has joined #ceph
[20:40] * zigo (~quassel@gplhost-3-pt.tunnel.tserv18.fra1.ipv6.he.net) has joined #ceph
[20:40] * blahnana (~bman@2602:ffe8:200:1::6019:93b3) has joined #ceph
[20:40] * dmsimard (~dmsimard@198.72.123.202) has joined #ceph
[20:40] * cephalobot (~ceph@ds3553.dreamservers.com) has joined #ceph
[20:40] * j^2 (~sid14252@id-14252.brockwell.irccloud.com) has joined #ceph
[20:40] * Archeron (~wade@wk.ws.ok.ubc.ca) has joined #ceph
[20:40] * jnq (~jnq@0001b7cc.user.oftc.net) has joined #ceph
[20:40] * infinity_ (~brendon@web2.artsopolis.com) has joined #ceph
[20:40] * rektide (~rektide@eldergods.com) has joined #ceph
[20:40] * toabctl (~toabctl@toabctl.de) has joined #ceph
[20:40] * garphy`aw (~garphy@frank.zone84.net) has joined #ceph
[20:40] * philips (~philips@ec2-54-196-103-51.compute-1.amazonaws.com) has joined #ceph
[20:40] * skorgu (skorgu@pylon.skorgu.net) has joined #ceph
[20:40] * ZyTer (~ZyTer@ghostbusters.apinnet.fr) has joined #ceph
[20:40] * Vivek (~vivek@0001171f.user.oftc.net) has joined #ceph
[20:40] * dwm (~dwm@northrend.tastycake.net) has joined #ceph
[20:40] * rturk-aw` (~rturk@ds3553.dreamservers.com) has joined #ceph
[20:40] * ChanServ sets mode +o scuttlemonkey
[20:41] * ZyTer (~ZyTer@ghostbusters.apinnet.fr) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * skorgu (skorgu@pylon.skorgu.net) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * garphy`aw (~garphy@frank.zone84.net) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * infinity_ (~brendon@web2.artsopolis.com) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * Archeron (~wade@wk.ws.ok.ubc.ca) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * seapasulli (~seapasull@95.85.33.150) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * skullone (~skullone@shell.skull-tech.com) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * dostrow (~dostrow@bunker.bloodmagic.com) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * getzburg (sid24913@id-24913.charlton.irccloud.com) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * danderson (~dave@atlas.natulte.net) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * CapnBB_away (~jog@nat.mrc-lmb.cam.ac.uk) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * Administrator_ (~Administr@172.245.26.218) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * wer (~wer@206-248-239-142.unassigned.ntelos.net) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * ccourtau- (~ccourtaut@2001:41d0:1:eed3::1) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * MACscr (~Adium@2601:d:c800:de3:30f7:6d93:6a03:5aec) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * pvh_sa_ (~pvh@105-236-14-252.access.mtnbusiness.co.za) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * rturk-aw` (~rturk@ds3553.dreamservers.com) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * JarekO (~jowsie@hC35A6AF2.cli.nitronet.pl) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * espeer (~quassel@phobos.isoho.st) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * marrusl (~mark@cpe-24-90-46-248.nyc.res.rr.com) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * rkeene (1011@oc9.org) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * jgornick_ (~jgornick@2600:3c00::f03c:91ff:fedf:72b4) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * Georgyo (~georgyo@shamm.as) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * sadbox (~jmcguire@sadbox.org) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * mjevans (~mjevans@li984-246.members.linode.com) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * _are_ (~quassel@2a01:238:4325:ca00:f065:c93c:f967:9285) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * dwm (~dwm@northrend.tastycake.net) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * philips (~philips@ec2-54-196-103-51.compute-1.amazonaws.com) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * toabctl (~toabctl@toabctl.de) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * j^2 (~sid14252@id-14252.brockwell.irccloud.com) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * dmsimard (~dmsimard@198.72.123.202) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * florz (nobody@2001:1a50:503c::2) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * Nats_ (~natscogs@114.31.195.238) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * lpabon (~quassel@24-151-54-34.dhcp.nwtn.ct.charter.com) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * yghannam (~yghannam@0001f8aa.user.oftc.net) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * rektide (~rektide@eldergods.com) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * kuroneko (~kuroneko@2600:3c01::f03c:91ff:fe96:1bfe) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * theanalyst (theanalyst@open.source.rocks.my.socks.firrre.com) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * scuttlemonkey (~scuttle@nat-pool-rdu-t.redhat.com) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * raso (~raso@deb-multimedia.org) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * Vivek (~vivek@0001171f.user.oftc.net) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * jnq (~jnq@0001b7cc.user.oftc.net) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * blahnana (~bman@2602:ffe8:200:1::6019:93b3) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * zigo (~quassel@gplhost-3-pt.tunnel.tserv18.fra1.ipv6.he.net) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * pmatulis (~peter@ec2-23-23-42-7.compute-1.amazonaws.com) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * cephalobot (~ceph@ds3553.dreamservers.com) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * beardo (~beardo__@beardo.cc.lehigh.edu) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * JoeJulian (~JoeJulian@shared.gaealink.net) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * acaos (~zac@209.99.103.42) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * cetex (~oskar@nadine.juza.se) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * bro_ (~flybyhigh@panik.darksystem.net) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * gleam (gleam@dolph.debacle.org) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * trond (~trond@evil-server.alseth.info) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * `10 (~10@69.169.91.14) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * hchen (~hchen@nat-pool-bos-t.redhat.com) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * huats (~quassel@stuart.objectif-libre.com) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * darkfader (~floh@88.79.251.60) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * s3an2_ (~sean@korn.s3an.me.uk) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * kklimonda (~kklimonda@ns331445.ip-37-187-121.eu) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * terje (~root@135.109.216.239) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * Jahkeup (Jahkeup@gemini.ca.us.panicbnc.net) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * maurosr (~maurosr_@bi-03pt2.bluebird.ibm.com) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * evilrob00 (~evilrob00@cpe-72-179-3-209.austin.res.rr.com) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * boichev (~boichev@213.169.56.130) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * rlrevell (~leer@vbo1.inmotionhosting.com) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * visbits (~textual@8.29.138.28) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * psiekl (psiekl@wombat.eu.org) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * cce (~cce@50.56.54.167) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * Kralian-1835 (~amd@not.7f.dk) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * derjohn_mob (~aj@x590c15ac.dyn.telefonica.de) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * carter (~carter@li98-136.members.linode.com) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * nwat (~nwat@kyoto.soe.ucsc.edu) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * alfredodeza (~alfredode@198.206.133.89) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * ccourtaut_ (~ccourtaut@178.62.125.124) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * ingard (~cake@tu.rd.vc) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * trociny (~mgolub@93.183.239.2) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * lbarfield (~logan@ralvm.saturne.in) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * lkoranda (~lkoranda@nat-pool-brq-t.redhat.com) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * jdillaman (~jdillaman@pool-173-66-110-250.washdc.fios.verizon.net) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * pdrakewe_ (~pdrakeweb@cpe-65-185-74-239.neo.res.rr.com) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * tserong (~tserong@203-214-92-220.dyn.iinet.net.au) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * fam (~famz@nat-pool-bos-t.redhat.com) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * HauM1 (~HauM1@login.univie.ac.at) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * MaZ- (~maz@00016955.user.oftc.net) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * nhm (~nhm@184-97-175-198.mpls.qwest.net) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * kraken (~kraken@gw.sepia.ceph.com) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * ctd (~root@00011932.user.oftc.net) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * steveeJ (~steveeJ@virthost3.stefanjunker.de) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * tmh_ (~e@loophole.cc) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * leseb_ (~leseb@81-64-215-19.rev.numericable.fr) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * arx (~arx@sniff-the.kittypla.net) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * Bosse (~bosse@2a03:b0c0:2:d0::3:1001) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * ToM- (~tom@85.188.1.168) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * eqhmcow (~eqhmcow@75.177.128.160) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * silvrax (~silvrax@wilson.xs4all.nl) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * MK_FG (~MK_FG@00018720.user.oftc.net) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * Xiol (~Xiol@shrike.daneelwell.eu) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * m0zes (~mozes@beocat.cis.ksu.edu) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * ianco (~ianco@r2.iancoffey.com) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * Be-El (~quassel@fb08-bcf-pc01.computational.bio.uni-giessen.de) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * smerz (~ircircirc@37.74.194.90) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * bene (~ben@c-24-60-237-191.hsd1.nh.comcast.net) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * reed (~reed@75-101-54-131.dsl.static.fusionbroadband.com) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * ebeerman (~ebeerman@64.202.160.88) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * spudly (~spudly@beaker.murf.org) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * dougf (~dougf@96-38-99-179.dhcp.jcsn.tn.charter.com) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * joshd (~jdurgin@206.169.83.146) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * dustinm` (~dustinm`@105.ip-167-114-152.net) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * jclm (~jclm@ip24-253-45-236.lv.lv.cox.net) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * sage (~quassel@2607:f298:6050:709d:cc6e:4e2c:d970:fa51) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * cephiroth (~oftc-webi@br167-098.ifremer.fr) Quit (synthon.oftc.net resistance.oftc.net)
[20:41] * cephiroth (~oftc-webi@br167-098.ifremer.fr) has joined #ceph
[20:42] * marrusl (~mark@cpe-24-90-46-248.nyc.res.rr.com) has joined #ceph
[20:42] * pvh_sa_ (~pvh@105-236-14-252.access.mtnbusiness.co.za) has joined #ceph
[20:42] * MACscr (~Adium@2601:d:c800:de3:30f7:6d93:6a03:5aec) has joined #ceph
[20:42] * yghannam (~yghannam@0001f8aa.user.oftc.net) has joined #ceph
[20:42] * lpabon (~quassel@24-151-54-34.dhcp.nwtn.ct.charter.com) has joined #ceph
[20:42] * mjevans (~mjevans@li984-246.members.linode.com) has joined #ceph
[20:42] * Nats_ (~natscogs@114.31.195.238) has joined #ceph
[20:42] * ccourtau- (~ccourtaut@2001:41d0:1:eed3::1) has joined #ceph
[20:42] * wer (~wer@206-248-239-142.unassigned.ntelos.net) has joined #ceph
[20:42] * Administrator_ (~Administr@172.245.26.218) has joined #ceph
[20:42] * CapnBB_away (~jog@nat.mrc-lmb.cam.ac.uk) has joined #ceph
[20:42] * theanalyst (theanalyst@open.source.rocks.my.socks.firrre.com) has joined #ceph
[20:42] * sadbox (~jmcguire@sadbox.org) has joined #ceph
[20:42] * danderson (~dave@atlas.natulte.net) has joined #ceph
[20:42] * pmatulis (~peter@ec2-23-23-42-7.compute-1.amazonaws.com) has joined #ceph
[20:42] * getzburg (sid24913@id-24913.charlton.irccloud.com) has joined #ceph
[20:42] * Georgyo (~georgyo@shamm.as) has joined #ceph
[20:42] * jgornick_ (~jgornick@2600:3c00::f03c:91ff:fedf:72b4) has joined #ceph
[20:42] * florz (nobody@2001:1a50:503c::2) has joined #ceph
[20:42] * raso (~raso@deb-multimedia.org) has joined #ceph
[20:42] * JarekO (~jowsie@hC35A6AF2.cli.nitronet.pl) has joined #ceph
[20:42] * scuttlemonkey (~scuttle@nat-pool-rdu-t.redhat.com) has joined #ceph
[20:42] * _are_ (~quassel@2a01:238:4325:ca00:f065:c93c:f967:9285) has joined #ceph
[20:42] * dostrow (~dostrow@bunker.bloodmagic.com) has joined #ceph
[20:42] * skullone (~skullone@shell.skull-tech.com) has joined #ceph
[20:42] * seapasulli (~seapasull@95.85.33.150) has joined #ceph
[20:42] * rkeene (1011@oc9.org) has joined #ceph
[20:42] * espeer (~quassel@phobos.isoho.st) has joined #ceph
[20:42] * kuroneko (~kuroneko@2600:3c01::f03c:91ff:fe96:1bfe) has joined #ceph
[20:42] * zigo (~quassel@gplhost-3-pt.tunnel.tserv18.fra1.ipv6.he.net) has joined #ceph
[20:42] * blahnana (~bman@2602:ffe8:200:1::6019:93b3) has joined #ceph
[20:42] * dmsimard (~dmsimard@198.72.123.202) has joined #ceph
[20:42] * cephalobot (~ceph@ds3553.dreamservers.com) has joined #ceph
[20:42] * j^2 (~sid14252@id-14252.brockwell.irccloud.com) has joined #ceph
[20:42] * Archeron (~wade@wk.ws.ok.ubc.ca) has joined #ceph
[20:42] * jnq (~jnq@0001b7cc.user.oftc.net) has joined #ceph
[20:42] * infinity_ (~brendon@web2.artsopolis.com) has joined #ceph
[20:42] * rektide (~rektide@eldergods.com) has joined #ceph
[20:42] * toabctl (~toabctl@toabctl.de) has joined #ceph
[20:42] * garphy`aw (~garphy@frank.zone84.net) has joined #ceph
[20:42] * philips (~philips@ec2-54-196-103-51.compute-1.amazonaws.com) has joined #ceph
[20:42] * skorgu (skorgu@pylon.skorgu.net) has joined #ceph
[20:42] * ZyTer (~ZyTer@ghostbusters.apinnet.fr) has joined #ceph
[20:42] * Vivek (~vivek@0001171f.user.oftc.net) has joined #ceph
[20:42] * dwm (~dwm@northrend.tastycake.net) has joined #ceph
[20:42] * rturk-aw` (~rturk@ds3553.dreamservers.com) has joined #ceph
[20:42] * ChanServ sets mode +v scuttlemonkey
[20:43] * georgem (~Adium@fwnat.oicr.on.ca) has joined #ceph
[20:43] * snerd (~motk@2600:3c00::f03c:91ff:fedb:2295) has joined #ceph
[20:43] * ircolle (~Adium@2601:1:a580:1735:85b0:e558:fa8:e21d) has joined #ceph
[20:43] * colonD (~colonD@173-165-224-105-minnesota.hfc.comcastbusiness.net) has joined #ceph
[20:43] * BranchPredictor (branch@predictor.org.pl) has joined #ceph
[20:43] * ktdreyer (~kdreyer@polyp.adiemus.org) has joined #ceph
[20:43] * mdxi (~mdxi@50-199-109-154-static.hfc.comcastbusiness.net) has joined #ceph
[20:43] * Kingrat (~shiny@2605:a000:1607:4000:f1a6:6113:f1b8:9f34) has joined #ceph
[20:43] * elder (~elder@c-24-245-18-91.hsd1.mn.comcast.net) has joined #ceph
[20:43] * chasmo77 (~chas77@158.183-62-69.ftth.swbr.surewest.net) has joined #ceph
[20:43] * joao (~joao@249.38.136.95.rev.vodafone.pt) has joined #ceph
[20:43] * hflai_ (hflai@alumni.cs.nctu.edu.tw) has joined #ceph
[20:43] * funnel (~funnel@0001c7d4.user.oftc.net) has joined #ceph
[20:43] * tom__ (~tom@167.88.45.146) has joined #ceph
[20:43] * Meths (~meths@2.27.78.187) has joined #ceph
[20:43] * _robbat21irssi (nobody@www2.orbis-terrarum.net) has joined #ceph
[20:43] * _nick (~nick@zarquon.dischord.org) has joined #ceph
[20:43] * ron-slc (~Ron@173-165-129-125-utah.hfc.comcastbusiness.net) has joined #ceph
[20:43] * nolan (~nolan@2001:470:1:41:a800:ff:fe3e:ad08) has joined #ceph
[20:43] * fretb (frederik@november.openminds.be) has joined #ceph
[20:43] * Tetard (~regnauld@x1.x0.dk) has joined #ceph
[20:43] * KindOne (kindone@0001a7db.user.oftc.net) has joined #ceph
[20:43] * Tene (~tene@173.13.139.236) has joined #ceph
[20:43] * palmeida (~palmeida@gandalf.wire-consulting.com) has joined #ceph
[20:43] * a1-away (~jelle@62.27.85.48) has joined #ceph
[20:43] * zz_hitsumabushi (~hitsumabu@175.184.30.148) has joined #ceph
[20:43] * stj (~stj@2604:a880:800:10::2cc:b001) has joined #ceph
[20:43] * sbadia (~sbadia@marcellin.sebian.fr) has joined #ceph
[20:43] * boolman (boolman@79.138.78.238) has joined #ceph
[20:43] * xrsanet (~nop@dev.xrsa.net) has joined #ceph
[20:43] * alexbligh1 (~alexbligh@89-16-176-215.no-reverse-dns-set.bytemark.co.uk) has joined #ceph
[20:43] * supay (sid47179@id-47179.uxbridge.irccloud.com) has joined #ceph
[20:43] * blueskin_ (~a@ks28333.kimsufi.com) has joined #ceph
[20:43] * jeffhung (~jeffhung@60-250-103-120.HINET-IP.hinet.net) has joined #ceph
[20:43] * ChanServ sets mode +o ircolle
[20:43] * ChanServ sets mode +v elder
[20:43] * ChanServ sets mode +v joao
[20:43] * derjohn_mob (~aj@x590c15ac.dyn.telefonica.de) has joined #ceph
[20:43] * pdrakewe_ (~pdrakeweb@cpe-65-185-74-239.neo.res.rr.com) has joined #ceph
[20:43] * visbits (~textual@8.29.138.28) has joined #ceph
[20:43] * rlrevell (~leer@vbo1.inmotionhosting.com) has joined #ceph
[20:43] * jdillaman (~jdillaman@pool-173-66-110-250.washdc.fios.verizon.net) has joined #ceph
[20:43] * nhm (~nhm@184-97-175-198.mpls.qwest.net) has joined #ceph
[20:43] * alfredodeza (~alfredode@198.206.133.89) has joined #ceph
[20:43] * leseb_ (~leseb@81-64-215-19.rev.numericable.fr) has joined #ceph
[20:43] * boichev (~boichev@213.169.56.130) has joined #ceph
[20:43] * tserong (~tserong@203-214-92-220.dyn.iinet.net.au) has joined #ceph
[20:43] * evilrob00 (~evilrob00@cpe-72-179-3-209.austin.res.rr.com) has joined #ceph
[20:43] * lkoranda (~lkoranda@nat-pool-brq-t.redhat.com) has joined #ceph
[20:43] * maurosr (~maurosr_@bi-03pt2.bluebird.ibm.com) has joined #ceph
[20:43] * lbarfield (~logan@ralvm.saturne.in) has joined #ceph
[20:43] * trociny (~mgolub@93.183.239.2) has joined #ceph
[20:43] * ingard (~cake@tu.rd.vc) has joined #ceph
[20:43] * ccourtaut_ (~ccourtaut@178.62.125.124) has joined #ceph
[20:43] * Jahkeup (Jahkeup@gemini.ca.us.panicbnc.net) has joined #ceph
[20:43] * terje (~root@135.109.216.239) has joined #ceph
[20:43] * kklimonda (~kklimonda@ns331445.ip-37-187-121.eu) has joined #ceph
[20:43] * tmh_ (~e@loophole.cc) has joined #ceph
[20:43] * s3an2_ (~sean@korn.s3an.me.uk) has joined #ceph
[20:43] * Kralian-1835 (~amd@not.7f.dk) has joined #ceph
[20:43] * darkfader (~floh@88.79.251.60) has joined #ceph
[20:43] * steveeJ (~steveeJ@virthost3.stefanjunker.de) has joined #ceph
[20:43] * huats (~quassel@stuart.objectif-libre.com) has joined #ceph
[20:43] * hchen (~hchen@nat-pool-bos-t.redhat.com) has joined #ceph
[20:43] * psiekl (psiekl@wombat.eu.org) has joined #ceph
[20:43] * HauM1 (~HauM1@login.univie.ac.at) has joined #ceph
[20:43] * nwat (~nwat@kyoto.soe.ucsc.edu) has joined #ceph
[20:43] * ctd (~root@00011932.user.oftc.net) has joined #ceph
[20:43] * kraken (~kraken@gw.sepia.ceph.com) has joined #ceph
[20:43] * cce (~cce@50.56.54.167) has joined #ceph
[20:43] * `10 (~10@69.169.91.14) has joined #ceph
[20:43] * carter (~carter@li98-136.members.linode.com) has joined #ceph
[20:43] * trond (~trond@evil-server.alseth.info) has joined #ceph
[20:43] * gleam (gleam@dolph.debacle.org) has joined #ceph
[20:43] * MaZ- (~maz@00016955.user.oftc.net) has joined #ceph
[20:43] * fam (~famz@nat-pool-bos-t.redhat.com) has joined #ceph
[20:43] * bro_ (~flybyhigh@panik.darksystem.net) has joined #ceph
[20:43] * cetex (~oskar@nadine.juza.se) has joined #ceph
[20:43] * acaos (~zac@209.99.103.42) has joined #ceph
[20:43] * JoeJulian (~JoeJulian@shared.gaealink.net) has joined #ceph
[20:43] * beardo (~beardo__@beardo.cc.lehigh.edu) has joined #ceph
[20:43] * jclm (~jclm@ip24-253-45-236.lv.lv.cox.net) has joined #ceph
[20:43] * ebeerman (~ebeerman@64.202.160.88) has joined #ceph
[20:43] * reed (~reed@75-101-54-131.dsl.static.fusionbroadband.com) has joined #ceph
[20:43] * bene (~ben@c-24-60-237-191.hsd1.nh.comcast.net) has joined #ceph
[20:43] * smerz (~ircircirc@37.74.194.90) has joined #ceph
[20:43] * Be-El (~quassel@fb08-bcf-pc01.computational.bio.uni-giessen.de) has joined #ceph
[20:43] * ianco (~ianco@r2.iancoffey.com) has joined #ceph
[20:43] * sage (~quassel@2607:f298:6050:709d:cc6e:4e2c:d970:fa51) has joined #ceph
[20:43] * dustinm` (~dustinm`@105.ip-167-114-152.net) has joined #ceph
[20:43] * m0zes (~mozes@beocat.cis.ksu.edu) has joined #ceph
[20:43] * Xiol (~Xiol@shrike.daneelwell.eu) has joined #ceph
[20:43] * joshd (~jdurgin@206.169.83.146) has joined #ceph
[20:43] * dougf (~dougf@96-38-99-179.dhcp.jcsn.tn.charter.com) has joined #ceph
[20:43] * MK_FG (~MK_FG@00018720.user.oftc.net) has joined #ceph
[20:43] * silvrax (~silvrax@wilson.xs4all.nl) has joined #ceph
[20:43] * eqhmcow (~eqhmcow@75.177.128.160) has joined #ceph
[20:43] * ToM- (~tom@85.188.1.168) has joined #ceph
[20:43] * Bosse (~bosse@2a03:b0c0:2:d0::3:1001) has joined #ceph
[20:43] * arx (~arx@sniff-the.kittypla.net) has joined #ceph
[20:43] * spudly (~spudly@beaker.murf.org) has joined #ceph
[20:43] * j^2 (~sid14252@id-14252.brockwell.irccloud.com) Quit ()
[20:45] * capri_on (~capri@212.218.127.222) has joined #ceph
[20:45] <dschneller> Be-el: As both problematic OSDs are marked out, would it impact the ongoing backfill to bring it up again? Just to see if it boots up.
[20:46] <dschneller> (Sorry, netsplit -- not sure what I / you missed)
[20:46] <Be-El> dschneller: you can try to bring one up again
[20:46] <dschneller> To make this easier from here on> Problematc = OSD 5 and 13
[20:47] <dschneller> we tried to bring 13 up.
[20:48] <LPustina_> And it resulted in the familiar log messages:
[20:48] <LPustina_> 2015-05-08 20:43:14.933065 7fb9a95a7700 0 -- 10.102.5.12:6812/11317 >> 10.102.5.13:6812/7854 pipe(0x4b5cbc00 sd=73 :36692 s=2 pgs=36195 cs=1 l=0 c=0x4b68a160).fault with nothing to send, going to standby
[20:48] <LPustina_> 2015-05-08 20:43:18.411143 7fb9fb2b6700 1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fb9b26dd700' had timed out after 15
[20:48] <LPustina_> And then a lot more 'time out after 15'
[20:49] <Be-El> did the osd process abort?
[20:49] * mykola (~Mikolaj@91.225.203.160) Quit (Remote host closed the connection)
[20:50] <dschneller> We did not try but stopped it again.
[20:50] <Be-El> ok, start it again and let it run. and monitor the system with atop
[20:51] <LPustina_> They commit suicide after a while, restart, and end up having the time out issue again.
[20:51] * capri (~capri@212.218.127.222) Quit (Ping timeout: 480 seconds)
[20:51] <dschneller> anything in particular to look for?
[20:52] <Be-El> in most cases i had with this log message, the osd recovered after a short time
[20:54] <Be-El> dschneller/LPustina_: is there anything interesting in the kernel logs?
[20:54] <Be-El> like read errors on the disk?
[20:55] <dschneller> While it starts up we see its disk saturating. We will try to increase the timeout in case it "starves itself" somehow.
[20:56] <LPustina_> I only seem to see the respawns in dmesg:
[20:56] <LPustina_> Fri May 8 20:26:53 2015] init: ceph-osd (ceph/13) main process (29017) killed by ABRT signal
[20:56] <LPustina_> [Fri May 8 20:26:53 2015] init: ceph-osd (ceph/13) main process ended, respawning
[20:56] <LPustina_> [Fri May 8 20:31:40 2015] init: ceph-osd (ceph/13) main process (14185) killed by KILL signal
[20:56] <LPustina_> [Fri May 8 22:19:30 2015] init: ceph-osd (ceph/13) main process (11317) killed by KILL signal
[20:56] * _br_ (~kalleeen@7R2AAAMWP.tor-irc.dnsbl.oftc.net) Quit ()
[20:56] * Aal (~w0lfeh@198.51.75.165) has joined #ceph
[20:57] <dschneller> It committed suicide again. however, before the timeout was increased, however.
[20:57] * visualne (~oftc-webi@50-88-223-216.res.bhn.net) has joined #ceph
[20:57] <dschneller> trying again with an increased timeout.
[20:58] <visualne> Hello, we are running a very old version of ceph. ceph version 0.61.2
[20:58] <Be-El> can you post the output of ceph -s in some pastebin?
[20:58] <visualne> and when trying to start a monitor the /var/lib/ceph/mon/store.db directory fils until the disk is completely full
[20:58] <visualne> does anyone know why this is?
[20:58] <visualne> once the disk is full the monitor dies
[20:59] <LPustina_> There you go Be-El: http://pastebin.com/raw.php?i=dXAQhcRm
[21:01] * ebeerman (~ebeerman@64.202.160.88) Quit (Quit: Leaving...)
[21:03] <LPustina_> Be-El: Is it possible that the OSDs need more time to correctly boot than the suicide timeout?
[21:03] * MentalRay (~MRay@MTRLPQ42-1176054809.sdsl.bell.ca) has joined #ceph
[21:03] <Be-El> LPustina_: it may be case. you can try to increase the timeout
[21:03] <LPustina_> We did. 4x.
[21:04] <Be-El> http://irclogs.ceph.widodh.nl/index.php?date=2014-08-30
[21:04] <LPustina_> But then, why does it get heartbeat timeouts =
[21:04] <LPustina_> ?
[21:04] <Be-El> maybe some problem with the filesystem
[21:04] <Be-El> ?
[21:04] <LPustina_> Oh. We didn't check that yet.
[21:05] <Be-El> which ceph version are you using?
[21:06] <LPustina_> ceph version 0.80.8
[21:06] <Be-El> that's firefly?
[21:07] <LPustina_> yes.
[21:08] <Be-El> ok, last thing for today (i'm already late for a party)....umount the file system or a flapping osd and remount it again
[21:08] * KevinPerks (~Adium@cpe-75-177-32-14.triad.res.rr.com) Quit (Read error: Connection reset by peer)
[21:08] * KevinPerks (~Adium@cpe-75-177-32-14.triad.res.rr.com) has joined #ceph
[21:08] * bandrus (~brian@59.sub-70-211-66.myvzw.com) Quit (Quit: Leaving.)
[21:08] <Be-El> do you use xfs or btrfs?
[21:09] <dschneller> xfs
[21:09] <dschneller> Unmounting already tried.
[21:09] <dschneller> next -- if the OSD does not come up with this increased timeout -- would be to unmount again und run xfs_check
[21:09] * shylesh (~shylesh@123.136.222.117) Quit (Remote host closed the connection)
[21:09] <Be-El> it may also be a problem with the controller
[21:11] <Be-El> but i'm afraid i'll have to leave now....there's a beer waiting for me
[21:11] <Be-El> or two....or 20...
[21:12] <LPustina_> Be-El: I'd prefer to have your problems :)
[21:13] <dschneller> Yeah... We might come to Giessen and join you.
[21:13] <LPustina_> Thanks so much for your help so far. Enjoy you're beer.
[21:13] <dschneller> What Lukas said.
[21:13] <Be-El> good luck with your osds
[21:13] * Be-El (~quassel@fb08-bcf-pc01.computational.bio.uni-giessen.de) Quit (Remote host closed the connection)
[21:14] * brutuscat (~brutuscat@105.34.133.37.dynamic.jazztel.es) has joined #ceph
[21:15] * brutuscat (~brutuscat@105.34.133.37.dynamic.jazztel.es) Quit (Remote host closed the connection)
[21:15] * sjmtest (uid32746@id-32746.uxbridge.irccloud.com) Quit (Quit: Connection closed for inactivity)
[21:17] * lpabon (~quassel@24-151-54-34.dhcp.nwtn.ct.charter.com) Quit (Ping timeout: 480 seconds)
[21:17] * Concubidated (~Adium@netblock-75-79-129-24.dslextreme.com) Quit (Quit: Leaving.)
[21:25] * georgem (~Adium@fwnat.oicr.on.ca) has left #ceph
[21:25] * daniel2_ (~dshafer@0001b605.user.oftc.net) has joined #ceph
[21:26] * Aal (~w0lfeh@5NZAACEY3.tor-irc.dnsbl.oftc.net) Quit ()
[21:26] * Gecko1986 (~Ralth@tor-exit2-readme.puckey.org) has joined #ceph
[21:34] * cpceph (~Adium@162.219.43.194) has joined #ceph
[21:36] * brutuscat (~brutuscat@105.34.133.37.dynamic.jazztel.es) has joined #ceph
[21:39] * tw0fish (~tw0fish@UNIX4.ANDREW.CMU.EDU) has joined #ceph
[21:40] <tw0fish> Has anyone experienced any unwarranted clock skews before? I have all the clocks syn'd, so not sure why it is detecting skews...
[21:44] <rlrevell> tw0fish: i have found that ceph falsely reports clock skew sometimes. i think it checks on boot before ntp has has a chance to sync then takes a while to correct itself
[21:46] <tw0fish> rlrevell: makes sense. one of the hosts seems to have a clock skew off/on. unless my NTP server is laggy, but it is on the LAN so i can't see the response time being that bad. I have Kerberos services running with the same NTP server and haven't seen an issue there. So, it doesn't make sense that I would have an NTP server problem.
[21:47] <tw0fish> it looks like the default skew is .05s .. maybe i will try a few things. can't see this being more sensitive than Kerberos, but maybe.
[21:48] <rlrevell> rlrevell: i didn't find it to be sensitive as much as slow to correct itself once the clocks become synced
[21:48] <tw0fish> plus the fact that 1 of my 3 mon hosts never has a skew problem and is on the same VLAN as the other 2 mon hosts and using the same NTP server.
[21:49] <tw0fish> rlrevell: cool. maybe i need to be patient. this is a newly built cluser.
[21:50] <tw0fish> :)
[21:55] * Concubidated (~Adium@71.21.5.251) has joined #ceph
[21:56] * Gecko1986 (~Ralth@789AAAOYQ.tor-irc.dnsbl.oftc.net) Quit ()
[21:56] * Maariu5_ (~Crisco@ns323918.ip-94-23-30.eu) has joined #ceph
[21:58] <tw0fish> rlrevell: it recovered! no more skews.
[21:59] <tw0fish> it looks like it takes ~15 min. or so..
[21:59] <rlrevell> tw0fish: yeah that happens every time i reboot a node
[22:00] * MentalRay (~MRay@MTRLPQ42-1176054809.sdsl.bell.ca) Quit (Quit: This computer has gone to sleep)
[22:06] * shaunm (~shaunm@cpe-65-185-127-82.cinci.res.rr.com) has joined #ceph
[22:08] * beardo (~beardo__@beardo.cc.lehigh.edu) Quit (synthon.oftc.net resistance.oftc.net)
[22:08] * JoeJulian (~JoeJulian@shared.gaealink.net) Quit (synthon.oftc.net resistance.oftc.net)
[22:08] * acaos (~zac@209.99.103.42) Quit (synthon.oftc.net resistance.oftc.net)
[22:08] * cetex (~oskar@nadine.juza.se) Quit (synthon.oftc.net resistance.oftc.net)
[22:08] * bro_ (~flybyhigh@panik.darksystem.net) Quit (synthon.oftc.net resistance.oftc.net)
[22:08] * gleam (gleam@dolph.debacle.org) Quit (synthon.oftc.net resistance.oftc.net)
[22:08] * trond (~trond@evil-server.alseth.info) Quit (synthon.oftc.net resistance.oftc.net)
[22:08] * `10 (~10@69.169.91.14) Quit (synthon.oftc.net resistance.oftc.net)
[22:08] * hchen (~hchen@nat-pool-bos-t.redhat.com) Quit (synthon.oftc.net resistance.oftc.net)
[22:08] * huats (~quassel@stuart.objectif-libre.com) Quit (synthon.oftc.net resistance.oftc.net)
[22:08] * darkfader (~floh@88.79.251.60) Quit (synthon.oftc.net resistance.oftc.net)
[22:08] * s3an2_ (~sean@korn.s3an.me.uk) Quit (synthon.oftc.net resistance.oftc.net)
[22:08] * kklimonda (~kklimonda@ns331445.ip-37-187-121.eu) Quit (synthon.oftc.net resistance.oftc.net)
[22:08] * terje (~root@135.109.216.239) Quit (synthon.oftc.net resistance.oftc.net)
[22:08] * Jahkeup (Jahkeup@gemini.ca.us.panicbnc.net) Quit (synthon.oftc.net resistance.oftc.net)
[22:08] * maurosr (~maurosr_@bi-03pt2.bluebird.ibm.com) Quit (synthon.oftc.net resistance.oftc.net)
[22:08] * evilrob00 (~evilrob00@cpe-72-179-3-209.austin.res.rr.com) Quit (synthon.oftc.net resistance.oftc.net)
[22:08] * boichev (~boichev@213.169.56.130) Quit (synthon.oftc.net resistance.oftc.net)
[22:08] * rlrevell (~leer@vbo1.inmotionhosting.com) Quit (synthon.oftc.net resistance.oftc.net)
[22:08] * visbits (~textual@8.29.138.28) Quit (synthon.oftc.net resistance.oftc.net)
[22:08] * psiekl (psiekl@wombat.eu.org) Quit (synthon.oftc.net resistance.oftc.net)
[22:08] * cce (~cce@50.56.54.167) Quit (synthon.oftc.net resistance.oftc.net)
[22:08] * Kralian-1835 (~amd@not.7f.dk) Quit (synthon.oftc.net resistance.oftc.net)
[22:08] * derjohn_mob (~aj@x590c15ac.dyn.telefonica.de) Quit (synthon.oftc.net resistance.oftc.net)
[22:08] * carter (~carter@li98-136.members.linode.com) Quit (synthon.oftc.net resistance.oftc.net)
[22:08] * nwat (~nwat@kyoto.soe.ucsc.edu) Quit (synthon.oftc.net resistance.oftc.net)
[22:08] * alfredodeza (~alfredode@198.206.133.89) Quit (synthon.oftc.net resistance.oftc.net)
[22:08] * ccourtaut_ (~ccourtaut@178.62.125.124) Quit (synthon.oftc.net resistance.oftc.net)
[22:08] * ingard (~cake@tu.rd.vc) Quit (synthon.oftc.net resistance.oftc.net)
[22:08] * trociny (~mgolub@93.183.239.2) Quit (synthon.oftc.net resistance.oftc.net)
[22:08] * lbarfield (~logan@ralvm.saturne.in) Quit (synthon.oftc.net resistance.oftc.net)
[22:08] * lkoranda (~lkoranda@nat-pool-brq-t.redhat.com) Quit (synthon.oftc.net resistance.oftc.net)
[22:08] * jdillaman (~jdillaman@pool-173-66-110-250.washdc.fios.verizon.net) Quit (synthon.oftc.net resistance.oftc.net)
[22:08] * pdrakewe_ (~pdrakeweb@cpe-65-185-74-239.neo.res.rr.com) Quit (synthon.oftc.net resistance.oftc.net)
[22:08] * tserong (~tserong@203-214-92-220.dyn.iinet.net.au) Quit (synthon.oftc.net resistance.oftc.net)
[22:08] * fam (~famz@nat-pool-bos-t.redhat.com) Quit (synthon.oftc.net resistance.oftc.net)
[22:08] * HauM1 (~HauM1@login.univie.ac.at) Quit (synthon.oftc.net resistance.oftc.net)
[22:08] * MaZ- (~maz@00016955.user.oftc.net) Quit (synthon.oftc.net resistance.oftc.net)
[22:08] * nhm (~nhm@184-97-175-198.mpls.qwest.net) Quit (synthon.oftc.net resistance.oftc.net)
[22:08] * kraken (~kraken@gw.sepia.ceph.com) Quit (synthon.oftc.net resistance.oftc.net)
[22:08] * ctd (~root@00011932.user.oftc.net) Quit (synthon.oftc.net resistance.oftc.net)
[22:08] * steveeJ (~steveeJ@virthost3.stefanjunker.de) Quit (synthon.oftc.net resistance.oftc.net)
[22:08] * tmh_ (~e@loophole.cc) Quit (synthon.oftc.net resistance.oftc.net)
[22:08] * leseb_ (~leseb@81-64-215-19.rev.numericable.fr) Quit (synthon.oftc.net resistance.oftc.net)
[22:08] * tw0fish (~tw0fish@UNIX4.ANDREW.CMU.EDU) Quit (synthon.oftc.net beauty.oftc.net)
[22:08] * shakamunyi (~shakamuny@209.66.74.34) Quit (synthon.oftc.net beauty.oftc.net)
[22:08] * sjm (~sjm@pool-173-70-76-86.nwrknj.fios.verizon.net) Quit (synthon.oftc.net beauty.oftc.net)
[22:08] * alram (~alram@cpe-172-250-2-46.socal.res.rr.com) Quit (synthon.oftc.net beauty.oftc.net)
[22:08] * joshd1 (~jdurgin@68-119-140-18.dhcp.ahvl.nc.charter.com) Quit (synthon.oftc.net beauty.oftc.net)
[22:08] * wushudoin (~wushudoin@209.132.181.86) Quit (synthon.oftc.net beauty.oftc.net)
[22:08] * primechuck (~primechuc@host-95-2-129.infobunker.com) Quit (synthon.oftc.net beauty.oftc.net)
[22:08] * dyasny (~dyasny@104.158.33.109) Quit (synthon.oftc.net beauty.oftc.net)
[22:08] * brad_mssw (~brad@66.129.88.50) Quit (synthon.oftc.net beauty.oftc.net)
[22:08] * cpceph (~Adium@162.219.43.194) Quit (synthon.oftc.net beauty.oftc.net)
[22:08] * morse (~morse@supercomputing.univpm.it) Quit (synthon.oftc.net beauty.oftc.net)
[22:08] * ChrisNBlum (~ChrisNBlu@178.255.153.117) Quit (synthon.oftc.net beauty.oftc.net)
[22:08] * Vacuum__ (~vovo@i59F7A3B9.versanet.de) Quit (synthon.oftc.net beauty.oftc.net)
[22:08] * martineg (~martin@shell01.copyleft.no) Quit (synthon.oftc.net beauty.oftc.net)
[22:08] * jeroenvh (~jeroen@37.74.194.90) Quit (synthon.oftc.net beauty.oftc.net)
[22:08] * fsimonce (~simon@host11-35-dynamic.32-79-r.retail.telecomitalia.it) Quit (synthon.oftc.net beauty.oftc.net)
[22:08] * dynamicudpate (~overonthe@199.68.193.54) Quit (synthon.oftc.net beauty.oftc.net)
[22:08] * PaulC (~paul@122-59-153-185.jetstream.xtra.co.nz) Quit (synthon.oftc.net beauty.oftc.net)
[22:08] * cfreak200 (andi@p4FF3E199.dip0.t-ipconnect.de) Quit (synthon.oftc.net beauty.oftc.net)
[22:08] * davidz (~davidz@2605:e000:1313:8003:e58b:bb59:cd07:ba82) Quit (synthon.oftc.net beauty.oftc.net)
[22:08] * wayneeseguin (~wayneeseg@mp64.overnothing.com) Quit (synthon.oftc.net beauty.oftc.net)
[22:08] * haomaiwa_ (~haomaiwan@118.244.254.16) Quit (synthon.oftc.net beauty.oftc.net)
[22:08] * kapsel (~k@psel.dk) Quit (synthon.oftc.net beauty.oftc.net)
[22:08] * dlan (~dennis@116.228.88.131) Quit (synthon.oftc.net beauty.oftc.net)
[22:08] * adeel (~adeel@2602:ffc1:1:face:50a2:3e38:867d:95b9) Quit (synthon.oftc.net beauty.oftc.net)
[22:08] * fxmulder (~fxmulder@cpe-24-55-6-128.austin.res.rr.com) Quit (synthon.oftc.net beauty.oftc.net)
[22:08] * Kupo1 (~tyler.wil@23.111.254.159) Quit (synthon.oftc.net beauty.oftc.net)
[22:08] * owasserm (~owasserm@52D9864F.cm-11-1c.dynamic.ziggo.nl) Quit (synthon.oftc.net beauty.oftc.net)
[22:08] * dmick (~dmick@206.169.83.146) Quit (synthon.oftc.net beauty.oftc.net)
[22:08] * fred`` (fred@earthli.ng) Quit (synthon.oftc.net beauty.oftc.net)
[22:08] * gregsfortytwo (~gregsfort@209.132.181.86) Quit (synthon.oftc.net beauty.oftc.net)
[22:08] * logan (~a@63.143.49.103) Quit (synthon.oftc.net beauty.oftc.net)
[22:08] * Larsen (~andreas@larsen.pl) Quit (synthon.oftc.net beauty.oftc.net)
[22:08] * fdmanana (~fdmanana@bl5-245-210.dsl.telepac.pt) Quit (synthon.oftc.net beauty.oftc.net)
[22:08] * portante (~portante@nat-pool-bos-t.redhat.com) Quit (synthon.oftc.net beauty.oftc.net)
[22:08] * schamane (~schamane@barriere.frankfurter-softwarefabrik.de) Quit (synthon.oftc.net beauty.oftc.net)
[22:08] * markl (~mark@knm.org) Quit (synthon.oftc.net beauty.oftc.net)
[22:08] * Anticimex (anticimex@185.19.66.194) Quit (synthon.oftc.net beauty.oftc.net)
[22:08] * cmdrk (~lincoln@c-71-194-163-11.hsd1.il.comcast.net) Quit (synthon.oftc.net beauty.oftc.net)
[22:09] * cmdrk (~lincoln@c-71-194-163-11.hsd1.il.comcast.net) has joined #ceph
[22:09] * Anticimex (anticimex@185.19.66.194) has joined #ceph
[22:09] * markl (~mark@knm.org) has joined #ceph
[22:09] * schamane (~schamane@barriere.frankfurter-softwarefabrik.de) has joined #ceph
[22:09] * portante (~portante@nat-pool-bos-t.redhat.com) has joined #ceph
[22:09] * fdmanana (~fdmanana@bl5-245-210.dsl.telepac.pt) has joined #ceph
[22:09] * Larsen (~andreas@larsen.pl) has joined #ceph
[22:09] * logan (~a@63.143.49.103) has joined #ceph
[22:09] * gregsfortytwo (~gregsfort@209.132.181.86) has joined #ceph
[22:09] * fred`` (fred@earthli.ng) has joined #ceph
[22:09] * dmick (~dmick@206.169.83.146) has joined #ceph
[22:09] * owasserm (~owasserm@52D9864F.cm-11-1c.dynamic.ziggo.nl) has joined #ceph
[22:09] * Kupo1 (~tyler.wil@23.111.254.159) has joined #ceph
[22:09] * fxmulder (~fxmulder@cpe-24-55-6-128.austin.res.rr.com) has joined #ceph
[22:09] * adeel (~adeel@2602:ffc1:1:face:50a2:3e38:867d:95b9) has joined #ceph
[22:09] * dlan (~dennis@116.228.88.131) has joined #ceph
[22:09] * haomaiwa_ (~haomaiwan@118.244.254.16) has joined #ceph
[22:09] * wayneeseguin (~wayneeseg@mp64.overnothing.com) has joined #ceph
[22:09] * davidz (~davidz@2605:e000:1313:8003:e58b:bb59:cd07:ba82) has joined #ceph
[22:09] * cfreak200 (andi@p4FF3E199.dip0.t-ipconnect.de) has joined #ceph
[22:09] * PaulC (~paul@122-59-153-185.jetstream.xtra.co.nz) has joined #ceph
[22:09] * dynamicudpate (~overonthe@199.68.193.54) has joined #ceph
[22:09] * fsimonce (~simon@host11-35-dynamic.32-79-r.retail.telecomitalia.it) has joined #ceph
[22:09] * jeroenvh (~jeroen@37.74.194.90) has joined #ceph
[22:09] * martineg (~martin@shell01.copyleft.no) has joined #ceph
[22:09] * kapsel (~k@psel.dk) has joined #ceph
[22:09] * Vacuum__ (~vovo@i59F7A3B9.versanet.de) has joined #ceph
[22:09] * ChrisNBlum (~ChrisNBlu@178.255.153.117) has joined #ceph
[22:09] * morse (~morse@supercomputing.univpm.it) has joined #ceph
[22:09] * brad_mssw (~brad@66.129.88.50) has joined #ceph
[22:09] * dyasny (~dyasny@104.158.33.109) has joined #ceph
[22:09] * primechuck (~primechuc@host-95-2-129.infobunker.com) has joined #ceph
[22:09] * wushudoin (~wushudoin@209.132.181.86) has joined #ceph
[22:09] * joshd1 (~jdurgin@68-119-140-18.dhcp.ahvl.nc.charter.com) has joined #ceph
[22:09] * alram (~alram@cpe-172-250-2-46.socal.res.rr.com) has joined #ceph
[22:09] * sjm (~sjm@pool-173-70-76-86.nwrknj.fios.verizon.net) has joined #ceph
[22:09] * shakamunyi (~shakamuny@209.66.74.34) has joined #ceph
[22:09] * cpceph (~Adium@162.219.43.194) has joined #ceph
[22:09] * tw0fish (~tw0fish@UNIX4.ANDREW.CMU.EDU) has joined #ceph
[22:09] * beardo (~beardo__@beardo.cc.lehigh.edu) has joined #ceph
[22:09] * JoeJulian (~JoeJulian@shared.gaealink.net) has joined #ceph
[22:09] * acaos (~zac@209.99.103.42) has joined #ceph
[22:09] * cetex (~oskar@nadine.juza.se) has joined #ceph
[22:09] * bro_ (~flybyhigh@panik.darksystem.net) has joined #ceph
[22:09] * fam (~famz@nat-pool-bos-t.redhat.com) has joined #ceph
[22:09] * MaZ- (~maz@00016955.user.oftc.net) has joined #ceph
[22:09] * gleam (gleam@dolph.debacle.org) has joined #ceph
[22:09] * trond (~trond@evil-server.alseth.info) has joined #ceph
[22:09] * carter (~carter@li98-136.members.linode.com) has joined #ceph
[22:09] * `10 (~10@69.169.91.14) has joined #ceph
[22:09] * cce (~cce@50.56.54.167) has joined #ceph
[22:09] * kraken (~kraken@gw.sepia.ceph.com) has joined #ceph
[22:09] * ctd (~root@00011932.user.oftc.net) has joined #ceph
[22:09] * nwat (~nwat@kyoto.soe.ucsc.edu) has joined #ceph
[22:09] * HauM1 (~HauM1@login.univie.ac.at) has joined #ceph
[22:09] * psiekl (psiekl@wombat.eu.org) has joined #ceph
[22:09] * hchen (~hchen@nat-pool-bos-t.redhat.com) has joined #ceph
[22:09] * huats (~quassel@stuart.objectif-libre.com) has joined #ceph
[22:09] * steveeJ (~steveeJ@virthost3.stefanjunker.de) has joined #ceph
[22:09] * darkfader (~floh@88.79.251.60) has joined #ceph
[22:09] * Kralian-1835 (~amd@not.7f.dk) has joined #ceph
[22:09] * s3an2_ (~sean@korn.s3an.me.uk) has joined #ceph
[22:09] * tmh_ (~e@loophole.cc) has joined #ceph
[22:09] * kklimonda (~kklimonda@ns331445.ip-37-187-121.eu) has joined #ceph
[22:09] * terje (~root@135.109.216.239) has joined #ceph
[22:09] * Jahkeup (Jahkeup@gemini.ca.us.panicbnc.net) has joined #ceph
[22:09] * ccourtaut_ (~ccourtaut@178.62.125.124) has joined #ceph
[22:09] * ingard (~cake@tu.rd.vc) has joined #ceph
[22:09] * trociny (~mgolub@93.183.239.2) has joined #ceph
[22:09] * lbarfield (~logan@ralvm.saturne.in) has joined #ceph
[22:09] * maurosr (~maurosr_@bi-03pt2.bluebird.ibm.com) has joined #ceph
[22:09] * lkoranda (~lkoranda@nat-pool-brq-t.redhat.com) has joined #ceph
[22:09] * evilrob00 (~evilrob00@cpe-72-179-3-209.austin.res.rr.com) has joined #ceph
[22:09] * tserong (~tserong@203-214-92-220.dyn.iinet.net.au) has joined #ceph
[22:09] * boichev (~boichev@213.169.56.130) has joined #ceph
[22:09] * leseb_ (~leseb@81-64-215-19.rev.numericable.fr) has joined #ceph
[22:09] * alfredodeza (~alfredode@198.206.133.89) has joined #ceph
[22:09] * nhm (~nhm@184-97-175-198.mpls.qwest.net) has joined #ceph
[22:09] * jdillaman (~jdillaman@pool-173-66-110-250.washdc.fios.verizon.net) has joined #ceph
[22:09] * rlrevell (~leer@vbo1.inmotionhosting.com) has joined #ceph
[22:09] * visbits (~textual@8.29.138.28) has joined #ceph
[22:09] * pdrakewe_ (~pdrakeweb@cpe-65-185-74-239.neo.res.rr.com) has joined #ceph
[22:09] * derjohn_mob (~aj@x590c15ac.dyn.telefonica.de) has joined #ceph
[22:09] * ChanServ sets mode +o dmick
[22:10] * visualne (~oftc-webi@50-88-223-216.res.bhn.net) Quit (Remote host closed the connection)
[22:11] * sjmtest (uid32746@id-32746.uxbridge.irccloud.com) has joined #ceph
[22:14] * Maariu5_ (~Crisco@789AAAOZP.tor-irc.dnsbl.oftc.net) Quit (synthon.oftc.net graviton.oftc.net)
[22:14] * arx (~arx@sniff-the.kittypla.net) Quit (synthon.oftc.net graviton.oftc.net)
[22:14] * Bosse (~bosse@2a03:b0c0:2:d0::3:1001) Quit (synthon.oftc.net graviton.oftc.net)
[22:14] * ToM- (~tom@85.188.1.168) Quit (synthon.oftc.net graviton.oftc.net)
[22:14] * eqhmcow (~eqhmcow@75.177.128.160) Quit (synthon.oftc.net graviton.oftc.net)
[22:14] * silvrax (~silvrax@wilson.xs4all.nl) Quit (synthon.oftc.net graviton.oftc.net)
[22:14] * MK_FG (~MK_FG@00018720.user.oftc.net) Quit (synthon.oftc.net graviton.oftc.net)
[22:14] * Xiol (~Xiol@shrike.daneelwell.eu) Quit (synthon.oftc.net graviton.oftc.net)
[22:14] * m0zes (~mozes@beocat.cis.ksu.edu) Quit (synthon.oftc.net graviton.oftc.net)
[22:14] * ianco (~ianco@r2.iancoffey.com) Quit (synthon.oftc.net graviton.oftc.net)
[22:14] * smerz (~ircircirc@37.74.194.90) Quit (synthon.oftc.net graviton.oftc.net)
[22:14] * bene (~ben@c-24-60-237-191.hsd1.nh.comcast.net) Quit (synthon.oftc.net graviton.oftc.net)
[22:14] * spudly (~spudly@beaker.murf.org) Quit (synthon.oftc.net graviton.oftc.net)
[22:14] * dougf (~dougf@96-38-99-179.dhcp.jcsn.tn.charter.com) Quit (synthon.oftc.net graviton.oftc.net)
[22:14] * jclm (~jclm@ip24-253-45-236.lv.lv.cox.net) Quit (synthon.oftc.net graviton.oftc.net)
[22:14] * dustinm` (~dustinm`@105.ip-167-114-152.net) Quit (synthon.oftc.net graviton.oftc.net)
[22:14] * reed (~reed@75-101-54-131.dsl.static.fusionbroadband.com) Quit (synthon.oftc.net graviton.oftc.net)
[22:14] * joshd (~jdurgin@206.169.83.146) Quit (synthon.oftc.net graviton.oftc.net)
[22:14] * sage (~quassel@2607:f298:6050:709d:cc6e:4e2c:d970:fa51) Quit (synthon.oftc.net graviton.oftc.net)
[22:17] * DV (~veillard@2001:41d0:a:f29f::1) Quit (Ping timeout: 480 seconds)
[22:18] * shaunm (~shaunm@cpe-65-185-127-82.cinci.res.rr.com) Quit (Ping timeout: 480 seconds)
[22:19] * Maariu5_ (~Crisco@789AAAOZP.tor-irc.dnsbl.oftc.net) has joined #ceph
[22:19] * jclm (~jclm@ip24-253-45-236.lv.lv.cox.net) has joined #ceph
[22:19] * reed (~reed@75-101-54-131.dsl.static.fusionbroadband.com) has joined #ceph
[22:19] * smerz (~ircircirc@37.74.194.90) has joined #ceph
[22:19] * ianco (~ianco@r2.iancoffey.com) has joined #ceph
[22:19] * sage (~quassel@2607:f298:6050:709d:cc6e:4e2c:d970:fa51) has joined #ceph
[22:19] * dustinm` (~dustinm`@105.ip-167-114-152.net) has joined #ceph
[22:19] * m0zes (~mozes@beocat.cis.ksu.edu) has joined #ceph
[22:19] * Xiol (~Xiol@shrike.daneelwell.eu) has joined #ceph
[22:19] * joshd (~jdurgin@206.169.83.146) has joined #ceph
[22:19] * dougf (~dougf@96-38-99-179.dhcp.jcsn.tn.charter.com) has joined #ceph
[22:19] * MK_FG (~MK_FG@00018720.user.oftc.net) has joined #ceph
[22:19] * silvrax (~silvrax@wilson.xs4all.nl) has joined #ceph
[22:19] * eqhmcow (~eqhmcow@75.177.128.160) has joined #ceph
[22:19] * ToM- (~tom@85.188.1.168) has joined #ceph
[22:19] * Bosse (~bosse@2a03:b0c0:2:d0::3:1001) has joined #ceph
[22:19] * arx (~arx@sniff-the.kittypla.net) has joined #ceph
[22:19] * spudly (~spudly@beaker.murf.org) has joined #ceph
[22:20] * jdillaman (~jdillaman@pool-173-66-110-250.washdc.fios.verizon.net) Quit (Quit: jdillaman)
[22:20] * shakamunyi (~shakamuny@209.66.74.34) Quit (Ping timeout: 480 seconds)
[22:21] * brutuscat (~brutuscat@105.34.133.37.dynamic.jazztel.es) Quit (Remote host closed the connection)
[22:26] * Maariu5_ (~Crisco@789AAAOZP.tor-irc.dnsbl.oftc.net) Quit ()
[22:26] * Borf (~Ralth@UtopianNoise.tor-exit.sec.gd) has joined #ceph
[22:27] * DV (~veillard@2001:41d0:1:d478::1) has joined #ceph
[22:32] * dgurtner (~dgurtner@217-162-119-191.dynamic.hispeed.ch) Quit (Ping timeout: 480 seconds)
[22:36] * bkopilov (~bkopilov@bzq-79-183-181-186.red.bezeqint.net) has joined #ceph
[22:39] * rlrevell (~leer@vbo1.inmotionhosting.com) Quit (Ping timeout: 480 seconds)
[22:41] * dgurtner (~dgurtner@217-162-119-191.dynamic.hispeed.ch) has joined #ceph
[22:43] * tw0fish (~tw0fish@UNIX4.ANDREW.CMU.EDU) Quit (Quit: have a good weekend)
[22:45] * MentalRay (~MRay@MTRLPQ42-1176054809.sdsl.bell.ca) has joined #ceph
[22:47] * shakamunyi (~shakamuny@209.66.74.34) has joined #ceph
[22:51] * brutuscat (~brutuscat@105.34.133.37.dynamic.jazztel.es) has joined #ceph
[22:52] * primechuck (~primechuc@host-95-2-129.infobunker.com) Quit (Quit: Leaving...)
[22:56] * Borf (~Ralth@789AAAO0U.tor-irc.dnsbl.oftc.net) Quit ()
[22:56] * allenmelon (~allenmelo@81-89-96-90.blue.kundencontroller.de) has joined #ceph
[23:02] * i_m (~ivan.miro@83.149.35.19) Quit (Ping timeout: 480 seconds)
[23:06] * shakamunyi (~shakamuny@209.66.74.34) Quit (Read error: Connection reset by peer)
[23:07] * jclm (~jclm@ip24-253-45-236.lv.lv.cox.net) Quit (Quit: Leaving.)
[23:07] * jclm (~jclm@ip24-253-45-236.lv.lv.cox.net) has joined #ceph
[23:09] * jrankin (~jrankin@d53-64-170-236.nap.wideopenwest.com) Quit (Quit: Leaving)
[23:11] * jclm1 (~jclm@ip24-253-45-236.lv.lv.cox.net) has joined #ceph
[23:16] * tupper (~tcole@2001:420:2280:1272:8900:f9b8:3b49:567e) Quit (Ping timeout: 480 seconds)
[23:17] * jclm (~jclm@ip24-253-45-236.lv.lv.cox.net) Quit (Ping timeout: 480 seconds)
[23:21] * shakamunyi (~shakamuny@209.66.74.34) has joined #ceph
[23:25] * MACscr (~Adium@2601:d:c800:de3:30f7:6d93:6a03:5aec) Quit (Quit: Leaving.)
[23:26] * MentalRay (~MRay@MTRLPQ42-1176054809.sdsl.bell.ca) Quit (Quit: This computer has gone to sleep)
[23:26] * allenmelon (~allenmelo@789AAAO1Z.tor-irc.dnsbl.oftc.net) Quit ()
[23:26] * Maariu5_ (~tuhnis@62-210-37-82.rev.poneytelecom.eu) has joined #ceph
[23:32] * OutOfNoWhere (~rpb@199.68.195.102) has joined #ceph
[23:32] * owasserm (~owasserm@52D9864F.cm-11-1c.dynamic.ziggo.nl) Quit (Quit: Ex-Chat)
[23:37] * brutuscat (~brutuscat@105.34.133.37.dynamic.jazztel.es) Quit (Remote host closed the connection)
[23:41] * MentalRay (~MRay@MTRLPQ42-1176054809.sdsl.bell.ca) has joined #ceph
[23:43] * brutuscat (~brutuscat@105.34.133.37.dynamic.jazztel.es) has joined #ceph
[23:46] * brad_mssw (~brad@66.129.88.50) Quit (Quit: Leaving)
[23:47] * dgurtner (~dgurtner@217-162-119-191.dynamic.hispeed.ch) Quit (Ping timeout: 480 seconds)
[23:53] * cpceph (~Adium@162.219.43.194) has left #ceph
[23:55] * fdmanana (~fdmanana@bl5-245-210.dsl.telepac.pt) Quit (Ping timeout: 480 seconds)
[23:56] * Maariu5_ (~tuhnis@789AAAO24.tor-irc.dnsbl.oftc.net) Quit ()
[23:56] * shaunm (~shaunm@74.215.76.114) has joined #ceph
[23:56] * ahmeni (~Esge@81-89-96-91.blue.kundencontroller.de) has joined #ceph

These logs were automatically created by CephLogBot on irc.oftc.net using the Java IRC LogBot.