#ceph IRC Log

Index

IRC Log for 2016-06-08

Timestamps are in GMT/BST.

[0:00] <m0zes__> I wasn???t rebalancing, and I don???t think the mds had a failover, but that was long before yesterday and my memory is definitely fading ;)
[0:00] <gregsfortytwo> heh
[0:00] <gregsfortytwo> well, anyway, other than the osd timeout
[0:01] <gregsfortytwo> once you bring the MDS up you may want to increase mds_max_purge_files, at least for a while
[0:01] <m0zes__> I was planning on letting it sit for a day before letting them in, and keeping the user doing mass deletions out until we can have a frank discussion about their behavior.
[0:01] <gregsfortytwo> it defaults to 64 files, and IIRC you have a lot more OSDs than that
[0:01] <m0zes__> sure do :)
[0:01] <gregsfortytwo> it also has mds_max_purge_ops (default 8192) and mds_max_purge_ops_per_pg (default 0.5)
[0:02] <gregsfortytwo> but unless the user has large files the max files and max per pg counts are the ones that matter
[0:02] <m0zes__> I???ve got to run. your pointers have been useful. thank you for your hard work
[0:02] <gregsfortytwo> np, good luck!
[0:04] <flaf> With cephfs in Jewel, when I have an "active" mds and a "standby-replay" mds, it's always the "standby-replay" mds which is printed by the command "ceph -s", not the "active" mds. Is it _really_ the expected behavior?
[0:05] <gregsfortytwo> heh, http://tracker.ceph.com/issues/15705
[0:06] <gregsfortytwo> tl;dr: bug, should be fixed in next point release
[0:06] * DV (~veillard@2001:41d0:a:f29f::1) Quit (Remote host closed the connection)
[0:07] <flaf> ah ok. I have answer gregsfortytwo. Thx. Another thing I have noticed in Jewel is that ???ceph mds dump" doesn't list the standby mds. It was the case in Infernalis.
[0:07] * DV (~veillard@2001:41d0:a:f29f::1) has joined #ceph
[0:07] <flaf> It was handy imho.
[0:07] * xENO_ (~Behedwin@7V7AAFVB7.tor-irc.dnsbl.oftc.net) Quit ()
[0:08] <flaf> And I have notice too there are many logs for the "standby-replay" mds.
[0:09] <flaf> I have every seconds the 2 same lines ???mds.0.0 standby_replay_restart (as standby)??? and ???mds.0.0 replay_done (as standby)???. It guess it's normal but it seems to me useless.
[0:10] * m0zes__ (~mozes@n117m02.cis.ksu.edu) Quit (Ping timeout: 480 seconds)
[0:18] * jowilkin (~jowilkin@2601:644:4000:b0bf:56ee:75ff:fe10:724e) Quit (Remote host closed the connection)
[0:18] <jiffe> whats the best way to troubleshoot performance issues? I'm migrating data from mongodb into ceph objects, initially things were going quite fast but the inserts into ceph are now taking a long time, and ceph doesn't seem to be using much cpu, disk or network io so I'm not sure where the slowdown is
[0:20] <jiffe> it seems to vary a lot, anywhere from 4 inserts per second to 30 inserts per second
[0:28] <The_Ball> after increasing PG/PGPs from 64 to 128 in a pool, I'm left with 4 degraded objects and 1pg degraded and undersized. It was 8 objects but restarting the osd brought it down to 4
[0:29] <The_Ball> How can I get out of this situation, should I out the osd and bring it back?
[0:29] <The_Ball> pg 8.3c is stuck unclean since forever, current state active+undersized+degraded, last acting [8,0]
[0:31] * wes_dillingham (~wes_dilli@209-6-222-74.c3-0.hdp-ubr1.sbo-hdp.ma.cable.rcn.com) has joined #ceph
[0:37] * Phase1 (~CobraKhan@7V7AAFVE5.tor-irc.dnsbl.oftc.net) has joined #ceph
[0:41] * xarses_ (~xarses@c-73-202-191-48.hsd1.ca.comcast.net) has joined #ceph
[0:47] * andreww (~xarses@c-73-202-191-48.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[0:48] * rendar (~I@host69-75-dynamic.0-87-r.retail.telecomitalia.it) Quit (Quit: std::lower_bound + std::less_equal *works* with a vector without duplicates!)
[0:53] * sudocat (~dibarra@192.185.1.20) Quit (Quit: Leaving.)
[0:56] <badone> The_Ball: did you look at http://docs.ceph.com/docs/master/rados/troubleshooting/troubleshooting-pg/ (master, since you didn't specify a version)?
[0:56] <badone> did you check what "info" says?
[0:58] <The_Ball> Thanks there's a lot of good info on that page, but haven't got my head around it all yet
[0:58] * skorgu (skorgu@pylon.skorgu.net) Quit (synthon.oftc.net charm.oftc.net)
[0:58] * mdxi (~mdxi@li925-141.members.linode.com) Quit (synthon.oftc.net charm.oftc.net)
[0:58] * jidar (~jidar@r2d2.fap.me) Quit (synthon.oftc.net charm.oftc.net)
[0:58] * rkeene (1011@oc9.org) Quit (synthon.oftc.net charm.oftc.net)
[0:58] * dec (~dec@223.119.197.104.bc.googleusercontent.com) Quit (synthon.oftc.net charm.oftc.net)
[0:58] * jackhill (~jackhill@bog.hcoop.net) Quit (synthon.oftc.net charm.oftc.net)
[0:58] * mischief (~mischief@iota.offblast.org) Quit (synthon.oftc.net charm.oftc.net)
[0:58] * chutz (~chutz@rygel.linuxfreak.ca) Quit (synthon.oftc.net charm.oftc.net)
[0:58] * skarn (skarn@0001f985.user.oftc.net) Quit (synthon.oftc.net charm.oftc.net)
[0:58] * mjevans (~mjevans@li984-246.members.linode.com) Quit (synthon.oftc.net charm.oftc.net)
[0:58] <The_Ball> Which "info" command are you referring to?
[1:00] * mjevans (~mjevans@li984-246.members.linode.com) has joined #ceph
[1:00] * rkeene (1011@oc9.org) has joined #ceph
[1:00] * chutz (~chutz@rygel.linuxfreak.ca) has joined #ceph
[1:00] * skarn (skarn@0001f985.user.oftc.net) has joined #ceph
[1:00] * jidar (~jidar@r2d2.fap.me) has joined #ceph
[1:00] * mischief (~mischief@iota.offblast.org) has joined #ceph
[1:00] * jackhill (~jackhill@bog.hcoop.net) has joined #ceph
[1:00] * mdxi (~mdxi@li925-141.members.linode.com) has joined #ceph
[1:00] * dec (~dec@223.119.197.104.bc.googleusercontent.com) has joined #ceph
[1:00] * skorgu (skorgu@pylon.skorgu.net) has joined #ceph
[1:00] * treenerd_ (~gsulzberg@cpe90-146-148-47.liwest.at) Quit (Quit: treenerd_)
[1:00] * whatevsz_ (~quassel@185.22.140.109) has joined #ceph
[1:01] * whatevsz__ (~quassel@b9168e90.cgn.dg-w.de) has joined #ceph
[1:01] * dyasny (~dyasny@cable-192.222.152.136.electronicbox.net) Quit (Ping timeout: 480 seconds)
[1:03] <badone> The_Ball: my bad, "ceph pg 0.5 query"
[1:03] <raeven> I have a strange problem in my test cluster. I can saturate a 1gbps link with write but when i try to read i get around half of the speed.
[1:03] <badone> I always confuse that for some reason
[1:04] <flaf> raeven: if the same link is used for the cluster and public network, it could be possible.
[1:05] * whatevsz___ (~quassel@185.22.140.109) has joined #ceph
[1:05] <The_Ball> badone, I've had a look at the query and nothing jumps out, but it looks like "CRUSH gives up too soon" in the troubleshooting-pg doc might be it
[1:06] <raeven> flaf: I only have one host so the replication should only be inside the same host or am i wrong in that assumption?
[1:06] <The_Ball> I get a mapping failure
[1:06] <badone> The_Ball: how many hosts?
[1:06] <badone> for OSDs
[1:06] <The_Ball> only three
[1:07] <flaf> raeven: ah... I don't know in this case. Maybe you are right.
[1:07] <badone> The_Ball: one thing you *could* try is setting size to 2 and see if they become clean
[1:07] * Phase1 (~CobraKhan@7V7AAFVE5.tor-irc.dnsbl.oftc.net) Quit ()
[1:07] * thundercloud (~mollstam@93.115.95.202) has joined #ceph
[1:08] <badone> it depends how much data you have and how much movement/activity you can tollerate
[1:08] * whatevsz (~quassel@b9168e90.cgn.dg-w.de) Quit (Ping timeout: 480 seconds)
[1:08] <The_Ball> badone, the pool I increased pg/pgps on was erasure coded, so it's size 3, min_size 2 atm
[1:08] * whatevsz_ (~quassel@185.22.140.109) Quit (Ping timeout: 480 seconds)
[1:09] <raeven> flaf: And the replication should be on write and not on read
[1:09] <raeven> so the numbers should be switched
[1:09] <The_Ball> badone, the magic number is 106 fail, 107 pass for "set_choose_tries"
[1:10] * lcurtis_ (~lcurtis@47.19.105.250) Quit (Ping timeout: 480 seconds)
[1:12] * MentalRay (~MentalRay@MTRLPQ42-1176054809.sdsl.bell.ca) has joined #ceph
[1:12] * whatevsz__ (~quassel@b9168e90.cgn.dg-w.de) Quit (Ping timeout: 480 seconds)
[1:15] <badone> The_Ball: you could add another node?
[1:16] <badone> oh, are you saying you've resolved it
[1:16] <badone> ?
[1:17] <The_Ball> badone, well I've updated the crush map with a higher value so that now all mappings succeed
[1:18] * oms101 (~oms101@p20030057EA071A00C6D987FFFE4339A1.dip0.t-ipconnect.de) Quit (Ping timeout: 480 seconds)
[1:18] <The_Ball> The 4 objects are still misplaced, but not sure how to trigger a "fix", I tried ceph pg repair 8.3c
[1:18] <badone> The_Ball: what version?
[1:18] <The_Ball> jewel
[1:19] <badone> The_Ball: hmmm... would you be interesting in restarting each of the OSDs involved in one of the pgs?
[1:19] <badone> acting and last
[1:19] <The_Ball> sure
[1:19] * stiopa (~stiopa@cpc73832-dals21-2-0-cust453.20-2.cable.virginm.net) Quit (Ping timeout: 480 seconds)
[1:20] <The_Ball> so would that be 0 and 6? pg 8.3c is stuck unclean since forever, current state active+remapped, last acting [8,0,6]
[1:22] <badone> The_Ball: 8, 0 and 6
[1:22] <badone> The_Ball: not all at the same time :)
[1:22] <The_Ball> no worries
[1:24] <badone> The_Ball: remapped should be temporary and it usually means a temporary set of OSDs has been mapped while the actual set of OSDs is backfilled or something similar
[1:25] <badone> The_Ball: what is the split on your EC? 4 + 2?
[1:26] <The_Ball> It's 2 + 1
[1:26] * oms101 (~oms101@p20030057EA79DE00C6D987FFFE4339A1.dip0.t-ipconnect.de) has joined #ceph
[1:26] <The_Ball> After restarting the osds 8,0,6 the pg status has changed back to active+undersized+degraded
[1:26] <The_Ball> pg 8.3c is active+undersized+degraded, acting [8,0]
[1:27] <badone> The_Ball: for whatever reason crush has decided it can't place the 3rd shard
[1:28] <badone> The_Ball: take a careful look at your crush mapping
[1:28] <The_Ball> which makes sense with the old crushmap
[1:30] * fdmanana (~fdmanana@2001:8a0:6e0c:6601:9135:a55b:27ec:cc48) Quit (Ping timeout: 480 seconds)
[1:37] * Sophie1 (~nicatronT@tor1e1.privacyfoundation.ch) has joined #ceph
[1:37] * thundercloud (~mollstam@4MJAAF46W.tor-irc.dnsbl.oftc.net) Quit ()
[1:39] * MentalRay (~MentalRay@MTRLPQ42-1176054809.sdsl.bell.ca) Quit (Ping timeout: 480 seconds)
[1:41] * wes_dillingham (~wes_dilli@209-6-222-74.c3-0.hdp-ubr1.sbo-hdp.ma.cable.rcn.com) Quit (Quit: wes_dillingham)
[1:51] * gregmark (~Adium@68.87.42.115) Quit (Quit: Leaving.)
[1:53] * Zuggtmoy (~zuggtmoy@2604:b500:a:15:585b:13e1:b451:d926) has joined #ceph
[1:54] * Skaag (~lunix@65.200.54.234) Quit (Quit: Leaving.)
[1:55] * bene (~bene@2601:18c:8501:41d0:ea2a:eaff:fe08:3c7a) Quit (Quit: Konversation terminated!)
[1:55] * joao (~joao@8.184.114.89.rev.vodafone.pt) has joined #ceph
[1:55] * ChanServ sets mode +o joao
[2:00] * jluis (~joao@8.184.114.89.rev.vodafone.pt) Quit (Ping timeout: 480 seconds)
[2:04] * yanzheng (~zhyan@118.116.113.63) has joined #ceph
[2:07] * Sophie1 (~nicatronT@06SAADNVY.tor-irc.dnsbl.oftc.net) Quit ()
[2:18] * dyasny (~dyasny@cable-192.222.152.136.electronicbox.net) has joined #ceph
[2:18] * Zuggtmoy (~zuggtmoy@2604:b500:a:15:585b:13e1:b451:d926) Quit (Quit: Leaving)
[2:22] * joelc (~joelc@cpe-24-28-78-20.austin.res.rr.com) has joined #ceph
[2:26] * vata (~vata@cable-192.222.249.207.electronicbox.net) has joined #ceph
[2:30] * joelc (~joelc@cpe-24-28-78-20.austin.res.rr.com) Quit (Ping timeout: 480 seconds)
[2:36] * wes_dillingham (~wes_dilli@209-6-222-74.c3-0.hdp-ubr1.sbo-hdp.ma.cable.rcn.com) has joined #ceph
[2:42] * CydeWeys (~w2k@tor1e1.privacyfoundation.ch) has joined #ceph
[2:45] * viisking (~viisking@183.80.255.12) has joined #ceph
[2:47] * MentalRay (~MentalRay@107.171.161.165) has joined #ceph
[2:47] * wushudoin (~wushudoin@2601:646:9501:d2b2:2ab2:bdff:fe0b:a6ee) Quit (Ping timeout: 480 seconds)
[2:48] * khyron (~khyron@189-210-86-40.static.axtel.net) has joined #ceph
[2:50] * MACscr (~Adium@c-73-9-230-5.hsd1.il.comcast.net) Quit (Ping timeout: 480 seconds)
[2:51] * messi2001 (~viisking@183.80.255.12) Quit (Ping timeout: 480 seconds)
[3:03] * hellertime (~Adium@pool-173-48-155-219.bstnma.fios.verizon.net) has joined #ceph
[3:08] * wes_dillingham (~wes_dilli@209-6-222-74.c3-0.hdp-ubr1.sbo-hdp.ma.cable.rcn.com) Quit (Quit: wes_dillingham)
[3:11] * xiucai (~hualingso@124.114.71.83) has joined #ceph
[3:12] * CydeWeys (~w2k@06SAADNYZ.tor-irc.dnsbl.oftc.net) Quit ()
[3:16] * murmur1 (~Frostshif@politkovskaja.torservers.net) has joined #ceph
[3:17] * MentalRay (~MentalRay@107.171.161.165) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[3:20] * neurodrone_ (~neurodron@162.243.191.67) has joined #ceph
[3:20] * wes_dillingham (~wes_dilli@209-6-222-74.c3-0.hdp-ubr1.sbo-hdp.ma.cable.rcn.com) has joined #ceph
[3:23] * Brochacho (~alberto@2601:243:504:6aa:8c39:923c:2ad3:ecc8) Quit (Quit: Brochacho)
[3:24] * mhuang (~mhuang@42.120.74.106) has joined #ceph
[3:26] <hellertime> ok continuing on with my osd recovery saga??? osd seem to be aborting during backfill ??? but they also are spewing out logs and so occasionally get hung up as the log volume frows to 100% full, osd logging level is 0/5 seems reasonable no?
[3:31] * georgem (~Adium@104-222-119-175.cpe.teksavvy.com) has joined #ceph
[3:31] * Nicola-1_ (~Nicola-19@x55b272a9.dyn.telefonica.de) has joined #ceph
[3:31] * pi_zhjw (~pi@139.129.6.152) Quit (Ping timeout: 480 seconds)
[3:31] * kefu (~kefu@183.193.187.174) has joined #ceph
[3:33] * wes_dillingham (~wes_dilli@209-6-222-74.c3-0.hdp-ubr1.sbo-hdp.ma.cable.rcn.com) Quit (Quit: wes_dillingham)
[3:35] * EinstCrazy (~EinstCraz@58.247.119.250) has joined #ceph
[3:35] * neurodrone_ (~neurodron@162.243.191.67) Quit (Ping timeout: 480 seconds)
[3:37] <badone> hellertime: very reasonable
[3:37] * Nicola-1980 (~Nicola-19@x4db48960.dyn.telefonica.de) Quit (Ping timeout: 480 seconds)
[3:37] <badone> the working log level is 0
[3:40] <hellertime> not sure why the osd are going up and down like a yoyo though???
[3:41] * EinstCra_ (~EinstCraz@58.247.119.250) has joined #ceph
[3:42] * wes_dillingham (~wes_dilli@209-6-222-74.c3-0.hdp-ubr1.sbo-hdp.ma.cable.rcn.com) has joined #ceph
[3:44] * EinstCr__ (~EinstCraz@58.247.119.250) has joined #ceph
[3:44] * EinstCrazy (~EinstCraz@58.247.119.250) Quit (Read error: Connection reset by peer)
[3:45] * khyron (~khyron@189-210-86-40.static.axtel.net) Quit (Quit: The computer fell asleep)
[3:46] * wes_dillingham (~wes_dilli@209-6-222-74.c3-0.hdp-ubr1.sbo-hdp.ma.cable.rcn.com) Quit ()
[3:46] * vbellur (~vijay@71.234.224.255) has joined #ceph
[3:46] * murmur1 (~Frostshif@4MJAAF5B9.tor-irc.dnsbl.oftc.net) Quit ()
[3:46] * tallest_red (~cooey@89.33.246.114) has joined #ceph
[3:47] * vivo (~viisking@183.80.255.12) has joined #ceph
[3:48] * wes_dillingham (~wes_dilli@209-6-222-74.c3-0.hdp-ubr1.sbo-hdp.ma.cable.rcn.com) has joined #ceph
[3:48] * vicente (~~vicente@125-227-238-55.HINET-IP.hinet.net) has joined #ceph
[3:49] * wes_dillingham (~wes_dilli@209-6-222-74.c3-0.hdp-ubr1.sbo-hdp.ma.cable.rcn.com) Quit ()
[3:49] * EinstCra_ (~EinstCraz@58.247.119.250) Quit (Ping timeout: 480 seconds)
[3:53] * viisking (~viisking@183.80.255.12) Quit (Ping timeout: 480 seconds)
[3:55] * vasu (~vasu@c-73-231-60-138.hsd1.ca.comcast.net) Quit (Quit: Leaving)
[4:02] * Kurt1 (~Adium@2001:628:1:5:405:f76f:a83e:dfc3) has joined #ceph
[4:02] * Kurt (~Adium@2001:628:1:5:e098:843e:2a6b:f76) Quit (Read error: Connection reset by peer)
[4:03] * aakso (aakso@hauki.tunkki.fi) has joined #ceph
[4:04] * T1 (~the_one@87.104.212.66) has joined #ceph
[4:04] * vicente_ (~~vicente@125-227-238-55.HINET-IP.hinet.net) has joined #ceph
[4:04] * praveen_ (~praveen@122.171.101.185) has joined #ceph
[4:05] * ben2 (ben@pearl.meh.net.nz) has joined #ceph
[4:05] * _are__ (~quassel@2a01:238:4325:ca00:f065:c93c:f967:9285) has joined #ceph
[4:05] * wjw-freebsd2 (~wjw@176.74.240.9) has joined #ceph
[4:05] * zigo_ (~quassel@gplhost-3-pt.tunnel.tserv18.fra1.ipv6.he.net) has joined #ceph
[4:05] * Nixx_ (~quassel@bulbasaur.sjorsgielen.nl) has joined #ceph
[4:05] * mitchty_ (~quassel@130-245-47-212.rev.cloud.scaleway.com) has joined #ceph
[4:05] * kiranos_ (~quassel@109.74.11.233) has joined #ceph
[4:05] * IvanJobs (~ivanjobs@103.50.11.146) has joined #ceph
[4:06] * goberle_ (~goberle@mid.ygg.tf) has joined #ceph
[4:06] * wjw-freebsd (~wjw@176.74.240.9) Quit (Ping timeout: 480 seconds)
[4:06] * tobiash_ (~quassel@212.118.206.70) has joined #ceph
[4:06] * owlbot (~supybot@pct-empresas-50.uc3m.es) Quit (Ping timeout: 480 seconds)
[4:06] * o0c (~o0c@chris.any.mx) has joined #ceph
[4:06] * mitchty (~quassel@130-245-47-212.rev.cloud.scaleway.com) Quit (Read error: Connection reset by peer)
[4:06] * Nixx (~quassel@bulbasaur.sjorsgielen.nl) Quit (Read error: Connection reset by peer)
[4:06] * EinstCr__ (~EinstCraz@58.247.119.250) Quit (Read error: Connection reset by peer)
[4:06] * chiluk (~quassel@172.34.213.162.lcy-01.canonistack.canonical.com) Quit (Read error: Connection reset by peer)
[4:06] * bauruine (~bauruine@2a01:4f8:202:54c7::beef) Quit (Ping timeout: 480 seconds)
[4:06] * EinstCrazy (~EinstCraz@58.247.119.250) has joined #ceph
[4:06] * tobiash (~quassel@212.118.206.70) Quit (Read error: Connection reset by peer)
[4:06] * bauruine_ (~bauruine@2a01:4f8:202:54c7::beef) has joined #ceph
[4:06] * wonko_be_ (bernard@november.openminds.be) has joined #ceph
[4:06] * ingvar_ (~ingvar@ingvar.users.bitbit.net) has joined #ceph
[4:06] * mschiff_ (~mschiff@mx10.schiffbauer.net) has joined #ceph
[4:06] * chiluk (~quassel@172.34.213.162.lcy-01.canonistack.canonical.com) has joined #ceph
[4:06] * nigwil_ (~Oz@li1416-21.members.linode.com) has joined #ceph
[4:06] * bauruine_ is now known as bauruine
[4:06] * liiwi_ (liiwi@idle.fi) has joined #ceph
[4:06] * ktdreyer_ (~kdreyer@polyp.adiemus.org) has joined #ceph
[4:06] * DLange_ (~DLange@dlange.user.oftc.net) has joined #ceph
[4:06] * boolman_ (boolman@79.138.78.238) has joined #ceph
[4:07] * kefu (~kefu@183.193.187.174) Quit (Ping timeout: 480 seconds)
[4:07] * nigwil (~Oz@li1416-21.members.linode.com) Quit (Read error: Connection reset by peer)
[4:07] * sfrode_ (frode@sandholtbraaten.com) has joined #ceph
[4:07] * ReSam (ReSam@0001fe39.user.oftc.net) Quit (Ping timeout: 480 seconds)
[4:07] * frickler_ (~jens@v1.jayr.de) has joined #ceph
[4:07] * vivo (~viisking@183.80.255.12) Quit (magnet.oftc.net coulomb.oftc.net)
[4:07] * vicente (~~vicente@125-227-238-55.HINET-IP.hinet.net) Quit (magnet.oftc.net coulomb.oftc.net)
[4:07] * xiucai (~hualingso@124.114.71.83) Quit (magnet.oftc.net coulomb.oftc.net)
[4:07] * krion (~seb@lisa.zetla.fr) Quit (magnet.oftc.net coulomb.oftc.net)
[4:07] * dlan (~dennis@116.228.88.131) Quit (magnet.oftc.net coulomb.oftc.net)
[4:07] * wgao (~wgao@106.120.101.38) Quit (magnet.oftc.net coulomb.oftc.net)
[4:07] * Cybertinus (~Cybertinu@cybertinus.customer.cloud.nl) Quit (magnet.oftc.net coulomb.oftc.net)
[4:07] * kjetijor (kjetijor@microbel.pvv.ntnu.no) Quit (magnet.oftc.net coulomb.oftc.net)
[4:07] * raso (~raso@ns.deb-multimedia.org) Quit (magnet.oftc.net coulomb.oftc.net)
[4:07] * nass5 (~fred@dn-infra-12.lionnois.site.univ-lorraine.fr) Quit (magnet.oftc.net coulomb.oftc.net)
[4:07] * dugravot6 (~dugravot6@194.199.223.4) Quit (magnet.oftc.net coulomb.oftc.net)
[4:07] * chengpeng (~chris@180.168.197.82) Quit (magnet.oftc.net coulomb.oftc.net)
[4:07] * kklimonda (~kklimonda@2001:41d0:a:f2b5::1) Quit (magnet.oftc.net coulomb.oftc.net)
[4:07] * murmur_ (~murmur@zeeb.org) Quit (magnet.oftc.net coulomb.oftc.net)
[4:07] * ben1 (ben@pearl.meh.net.nz) Quit (magnet.oftc.net coulomb.oftc.net)
[4:07] * liiwi (liiwi@idle.fi) Quit (magnet.oftc.net coulomb.oftc.net)
[4:07] * sileht (~sileht@gizmo.sileht.net) Quit (magnet.oftc.net coulomb.oftc.net)
[4:07] * lurbs (user@uber.geek.nz) Quit (magnet.oftc.net coulomb.oftc.net)
[4:07] * bjornar (~bjornar@109.247.131.38) Quit (magnet.oftc.net coulomb.oftc.net)
[4:07] * al (quassel@niel.cx) Quit (magnet.oftc.net coulomb.oftc.net)
[4:07] * monsted (~monsted@rootweiler.dk) Quit (magnet.oftc.net coulomb.oftc.net)
[4:07] * frickler (~jens@v1.jayr.de) Quit (magnet.oftc.net coulomb.oftc.net)
[4:07] * saltsa (~joonas@dsl-hkibrasgw1-58c018-65.dhcp.inet.fi) Quit (magnet.oftc.net coulomb.oftc.net)
[4:07] * lightspeed (~lightspee@fw-carp-wan.ext.lspeed.org) Quit (magnet.oftc.net coulomb.oftc.net)
[4:07] * Kvisle (~tv@tv.users.bitbit.net) Quit (magnet.oftc.net coulomb.oftc.net)
[4:07] * aakso_ (aakso@hauki.tunkki.fi) Quit (magnet.oftc.net coulomb.oftc.net)
[4:07] * harmw (~harmw@chat.manbearpig.nl) Quit (magnet.oftc.net coulomb.oftc.net)
[4:07] * mui (mui@eutanasia.mui.fi) Quit (magnet.oftc.net coulomb.oftc.net)
[4:07] * boolman (boolman@79.138.78.238) Quit (magnet.oftc.net coulomb.oftc.net)
[4:07] * abhishekvrshny (~abhishekv@180.179.116.54) Quit (magnet.oftc.net coulomb.oftc.net)
[4:07] * sfrode (frode@sandholtbraaten.com) Quit (magnet.oftc.net coulomb.oftc.net)
[4:07] * chrome0 (~chrome0@static.202.35.46.78.clients.your-server.de) Quit (magnet.oftc.net coulomb.oftc.net)
[4:07] * ingvar (~ingvar@ingvar.users.bitbit.net) Quit (magnet.oftc.net coulomb.oftc.net)
[4:07] * wido (~wido@2a00:f10:121:100:4a5:76ff:fe00:199) Quit (magnet.oftc.net coulomb.oftc.net)
[4:07] * ktdreyer (~kdreyer@polyp.adiemus.org) Quit (magnet.oftc.net coulomb.oftc.net)
[4:07] * HauM1 (~HauM1@login.univie.ac.at) Quit (magnet.oftc.net coulomb.oftc.net)
[4:07] * bla (~b.laessig@chimeria.ext.pengutronix.de) Quit (magnet.oftc.net coulomb.oftc.net)
[4:07] * thesix (~thesix@leifhelm.mur.at) Quit (magnet.oftc.net coulomb.oftc.net)
[4:07] * noooxqe (~noooxqe@1.ip-51-255-167.eu) Quit (magnet.oftc.net coulomb.oftc.net)
[4:07] * Anticimex (anticimex@netforce.sth.millnert.se) Quit (magnet.oftc.net coulomb.oftc.net)
[4:07] * flaf (~flaf@2001:41d0:1:7044::1) Quit (magnet.oftc.net coulomb.oftc.net)
[4:07] * wonko_be (bernard@november.openminds.be) Quit (magnet.oftc.net coulomb.oftc.net)
[4:07] * squisher (~dasquishe@seeker.mcbf.net) Quit (magnet.oftc.net coulomb.oftc.net)
[4:07] * DLange (~DLange@dlange.user.oftc.net) Quit (magnet.oftc.net coulomb.oftc.net)
[4:07] * gkoof3ovk (david@sugi.qzx.se) Quit (Write error: connection closed)
[4:07] * Kvisle (~tv@tv.users.bitbit.net) has joined #ceph
[4:07] * gkoof3ovk (david@sugi.qzx.se) has joined #ceph
[4:07] * ReSam (ReSam@catrobat-irc.ist.tu-graz.ac.at) has joined #ceph
[4:07] * lurbs (user@uber.geek.nz) has joined #ceph
[4:07] * mui (mui@eutanasia.mui.fi) has joined #ceph
[4:07] * itwasntandy (~andrew@bash.sh) Quit (Read error: Connection reset by peer)
[4:07] * Anticimex (anticimex@netforce.sth.millnert.se) has joined #ceph
[4:07] * itwasntandy (~andrew@bash.sh) has joined #ceph
[4:07] * saltsa (~joonas@dsl-hkibrasgw1-58c018-65.dhcp.inet.fi) has joined #ceph
[4:07] * xiucai (~hualingso@124.114.71.83) has joined #ceph
[4:07] * chengpeng (~chris@180.168.126.243) has joined #ceph
[4:08] * kefu (~kefu@114.92.104.47) has joined #ceph
[4:08] * LongyanG (~long@15255.s.time4vps.eu) Quit (Ping timeout: 480 seconds)
[4:08] * zigo (~quassel@gplhost-3-pt.tunnel.tserv18.fra1.ipv6.he.net) Quit (Read error: Connection reset by peer)
[4:08] * LongyanG (~long@15255.s.time4vps.eu) has joined #ceph
[4:08] * ifur (~osm@0001f63e.user.oftc.net) Quit (Ping timeout: 480 seconds)
[4:08] * praveen (~praveen@122.171.101.185) Quit (Ping timeout: 480 seconds)
[4:08] * DV (~veillard@2001:41d0:a:f29f::1) Quit (Remote host closed the connection)
[4:08] * _are_ (~quassel@2a01:238:4325:ca00:f065:c93c:f967:9285) Quit (Read error: Connection reset by peer)
[4:08] * Tetard (~regnauld@x1.x0.dk) Quit (Ping timeout: 480 seconds)
[4:09] * The1_ (~the_one@87.104.212.66) Quit (Ping timeout: 480 seconds)
[4:09] * mschiff (~mschiff@mx10.schiffbauer.net) Quit (Ping timeout: 480 seconds)
[4:09] * kiranos (~quassel@109.74.11.233) Quit (Ping timeout: 480 seconds)
[4:09] * germano (~germano@default-46-102-197-194.interdsl.co.uk) Quit (Ping timeout: 480 seconds)
[4:09] * goberle (~goberle@mid.ygg.tf) Quit (Ping timeout: 480 seconds)
[4:09] * tries (~tries__@2a01:2a8:2000:ffff:1260:4bff:fe6f:af91) Quit (Ping timeout: 480 seconds)
[4:09] * o0c_ (~o0c@chris.any.mx) Quit (Ping timeout: 480 seconds)
[4:09] * MaZ- (~maz@00016955.user.oftc.net) Quit (Ping timeout: 480 seconds)
[4:09] * tries (~tries__@2a01:2a8:2000:ffff:1260:4bff:fe6f:af91) has joined #ceph
[4:09] * monsted (~monsted@rootweiler.dk) has joined #ceph
[4:09] * germano (~germano@default-46-102-197-194.interdsl.co.uk) has joined #ceph
[4:09] * Tetard (~regnauld@x1.x0.dk) has joined #ceph
[4:10] * DV (~veillard@2001:41d0:a:f29f::1) has joined #ceph
[4:10] * MaZ- (~maz@00016955.user.oftc.net) has joined #ceph
[4:10] * noooxqe (~noooxqe@1.ip-51-255-167.eu) has joined #ceph
[4:10] * chrome0 (~chrome0@mail.sabaini.at) has joined #ceph
[4:11] * ifur (~osm@0001f63e.user.oftc.net) has joined #ceph
[4:12] * HauM1 (~HauM1@login.univie.ac.at) has joined #ceph
[4:12] * al (d@niel.cx) has joined #ceph
[4:12] * dlan (~dennis@116.228.88.131) has joined #ceph
[4:16] * kjetijor (kjetijor@microbel.pvv.ntnu.no) has joined #ceph
[4:16] * tallest_red (~cooey@4MJAAF5DI.tor-irc.dnsbl.oftc.net) Quit ()
[4:16] * n0x1d (~Dysgalt@relay1.tor.openinternet.io) has joined #ceph
[4:17] * krion (~seb@lisa.zetla.fr) has joined #ceph
[4:17] * lightspeed (~lightspee@fw-carp-wan.ext.lspeed.org) has joined #ceph
[4:17] * wgao (~wgao@106.120.101.38) has joined #ceph
[4:17] * bjornar (~bjornar@109.247.131.38) has joined #ceph
[4:17] * sileht (~sileht@gizmo.sileht.net) has joined #ceph
[4:18] * raso (~raso@ns.deb-multimedia.org) has joined #ceph
[4:18] * abhishekvrshny (~abhishekv@180.179.116.54) has joined #ceph
[4:18] * murmur (~murmur@zeeb.org) has joined #ceph
[4:18] * Cybertinus (~Cybertinu@cybertinus.customer.cloud.nl) has joined #ceph
[4:18] * kklimonda (~kklimonda@2001:41d0:a:f2b5::1) has joined #ceph
[4:18] * wido (~wido@2a00:f10:121:100:4a5:76ff:fe00:199) has joined #ceph
[4:18] * harmw (~harmw@chat.manbearpig.nl) has joined #ceph
[4:18] * flaf (~flaf@2001:41d0:1:7044::1) has joined #ceph
[4:18] * bla (~b.laessig@chimeria.ext.pengutronix.de) has joined #ceph
[4:18] * thesix (~thesix@leifhelm.mur.at) has joined #ceph
[4:18] * squisher (~dasquishe@seeker.mcbf.net) has joined #ceph
[4:18] * winston-d_ (uid98317@id-98317.richmond.irccloud.com) has joined #ceph
[4:19] * neurodrone_ (~neurodron@pool-100-35-225-168.nwrknj.fios.verizon.net) has joined #ceph
[4:19] * nass5 (~fred@194.199.223.12) has joined #ceph
[4:20] * dugravot6 (~dugravot6@194.199.223.4) has joined #ceph
[4:28] <xiucai> excuse me:) in crush ruleset, must host bucket name be the same as hostname ?
[4:29] <xiucai> can somebody help me :)
[4:29] <[arx]> haven't tried it before, but i don't see why it would be required
[4:32] * ReSam (ReSam@0001fe39.user.oftc.net) Quit (Quit: ZNC - http://znc.in)
[4:33] * ReSam (ReSam@catrobat-irc.ist.tu-graz.ac.at) has joined #ceph
[4:33] <xiucai> there are SASes & SSDs exist in my machine, now i want divide them into 2 group.
[4:34] <xiucai> so i can configure crush rulesets, one for fast pool with ssd, one for common pool with sas.
[4:34] * neurodrone_ (~neurodron@pool-100-35-225-168.nwrknj.fios.verizon.net) Quit (Quit: neurodrone_)
[4:35] * neurodrone_ (~neurodron@pool-100-35-225-168.nwrknj.fios.verizon.net) has joined #ceph
[4:38] <[arx]> just tried it, the names for any bucket type are just a arbitrary string
[4:40] * scg (~zscg@c-50-169-194-217.hsd1.ma.comcast.net) has joined #ceph
[4:41] * scg (~zscg@c-50-169-194-217.hsd1.ma.comcast.net) Quit ()
[4:46] * n0x1d (~Dysgalt@7V7AAFVQO.tor-irc.dnsbl.oftc.net) Quit ()
[4:46] * tuhnis (~Eric@torrelay4.tomhek.net) has joined #ceph
[4:47] * wes_dillingham (~wes_dilli@209-6-222-74.c3-0.hdp-ubr1.sbo-hdp.ma.cable.rcn.com) has joined #ceph
[4:52] * ira (~ira@c-24-34-255-34.hsd1.ma.comcast.net) Quit (Ping timeout: 480 seconds)
[4:53] * i_m (~ivan.miro@nat-5-carp.hcn-strela.ru) Quit (Ping timeout: 480 seconds)
[4:57] * xiucai (~hualingso@124.114.71.83) Quit (Ping timeout: 480 seconds)
[4:58] * xiucai (~hualingso@124.114.71.83) has joined #ceph
[5:03] * Skaag (~lunix@cpe-172-91-77-84.socal.res.rr.com) has joined #ceph
[5:03] * mhuang (~mhuang@42.120.74.106) Quit (Quit: This computer has gone to sleep)
[5:11] <hellertime> ok so my osd keep dying, leaving me with 4k undersized pgs??? but when I bring the osd backonline they are overwhelmed with recovery action, which eventually leads them to abort and so the process repeats???
[5:11] <hellertime> is there some controlled way to bring back online osd without swamping them with recovery traffic?
[5:11] * NTTEC (~nttec@203.177.235.23) has joined #ceph
[5:13] * EinstCrazy (~EinstCraz@58.247.119.250) Quit (Remote host closed the connection)
[5:14] * neurodrone_ (~neurodron@pool-100-35-225-168.nwrknj.fios.verizon.net) Quit (Quit: neurodrone_)
[5:16] * wes_dillingham (~wes_dilli@209-6-222-74.c3-0.hdp-ubr1.sbo-hdp.ma.cable.rcn.com) Quit (Quit: wes_dillingham)
[5:16] * tuhnis (~Eric@7V7AAFVR6.tor-irc.dnsbl.oftc.net) Quit ()
[5:16] * Thayli (~PappI@exit1.torproxy.org) has joined #ceph
[5:21] * MentalRay (~MentalRay@107.171.161.165) has joined #ceph
[5:23] * Vacuum_ (~Vacuum@i59F7977C.versanet.de) has joined #ceph
[5:25] * mhuang (~mhuang@42.120.74.106) has joined #ceph
[5:26] * mhuang (~mhuang@42.120.74.106) Quit ()
[5:27] <badone> hellertime: there are tunings for recovery threads
[5:27] <hellertime> I found these settings:
[5:27] <hellertime> osd max backfills = 1
[5:27] <hellertime> osd recovery max active = 1
[5:27] <badone> http://lists.ceph.com/pipermail/ceph-users-ceph.com/2014-April/038989.html
[5:27] <hellertime> so far with that things seem very promising...
[5:27] <badone> that looks close
[5:28] <hellertime> nice link. I'l bookmark that too
[5:30] * Vacuum__ (~Vacuum@88.130.217.103) Quit (Ping timeout: 480 seconds)
[5:33] * bvi (~Bastiaan@152-64-132-5.ftth.glasoperator.nl) Quit (Quit: Leaving)
[5:37] * georgem (~Adium@104-222-119-175.cpe.teksavvy.com) Quit (Quit: Leaving.)
[5:39] * sbfox (~Adium@192.235.146.98) has joined #ceph
[5:39] <hellertime> wow. that worked really well. all osd are up, but one and that seems to have trouble replaying its journal!
[5:40] <hellertime> is it best to mark osd as out if they are going to be offline for a prolonged period of time?
[5:43] * EinstCrazy (~EinstCraz@58.247.119.250) has joined #ceph
[5:45] * mhuang (~mhuang@42.120.74.106) has joined #ceph
[5:46] * Thayli (~PappI@06SAADN9Z.tor-irc.dnsbl.oftc.net) Quit ()
[5:46] * Xa (~poller@ns316491.ip-37-187-129.eu) has joined #ceph
[5:47] * EinstCrazy (~EinstCraz@58.247.119.250) Quit (Remote host closed the connection)
[5:50] * xinxinsh (~xinxinsh@112.64.141.50) has joined #ceph
[6:00] * sbfox (~Adium@192.235.146.98) Quit (Quit: Leaving.)
[6:04] * xinxinsh (~xinxinsh@112.64.141.50) Quit (Ping timeout: 480 seconds)
[6:06] * reed (~reed@75-101-54-18.dsl.static.fusionbroadband.com) Quit (Quit: Ex-Chat)
[6:06] * agsha (~agsha@124.40.246.234) Quit (Read error: Connection reset by peer)
[6:08] * yanzheng1 (~zhyan@118.116.113.63) has joined #ceph
[6:09] * yanzheng (~zhyan@118.116.113.63) Quit (Ping timeout: 480 seconds)
[6:11] * mhuang (~mhuang@42.120.74.106) Quit (Ping timeout: 480 seconds)
[6:13] * sbfox (~Adium@192.235.146.98) has joined #ceph
[6:14] * sbfox (~Adium@192.235.146.98) Quit ()
[6:15] * sbfox (~Adium@192.235.146.98) has joined #ceph
[6:16] * Xa (~poller@4MJAAF5L6.tor-irc.dnsbl.oftc.net) Quit ()
[6:16] * Coe|work (~Xeon06@81-7-15-115.blue.kundencontroller.de) has joined #ceph
[6:18] * joelc (~joelc@cpe-24-28-78-20.austin.res.rr.com) has joined #ceph
[6:22] * EinstCrazy (~EinstCraz@58.247.119.250) has joined #ceph
[6:26] * joelc (~joelc@cpe-24-28-78-20.austin.res.rr.com) Quit (Ping timeout: 480 seconds)
[6:35] * jermudgeon (~jhaustin@tab.biz.whitestone.link) has joined #ceph
[6:35] * jermudgeon (~jhaustin@tab.biz.whitestone.link) Quit ()
[6:36] * jermudgeon (~jhaustin@tab.biz.whitestone.link) has joined #ceph
[6:43] * MentalRay (~MentalRay@107.171.161.165) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[6:46] * Coe|work (~Xeon06@7V7AAFVVL.tor-irc.dnsbl.oftc.net) Quit ()
[6:46] * narthollis (~EdGruberm@exit1.ipredator.se) has joined #ceph
[6:47] <hellertime> hmm
[6:47] <hellertime> I've not seen this before:
[6:47] * owasserm (~owasserm@2001:984:d3f7:1:5ec5:d4ff:fee0:f6dc) Quit (Ping timeout: 480 seconds)
[6:47] <hellertime> osd.141 228104 load_pgs: have pgid 0.19 at epoch 228205, but missing map. Crashing.
[6:48] <hellertime> anyone else?
[6:49] * puffy (~puffy@c-71-198-18-187.hsd1.ca.comcast.net) has joined #ceph
[6:49] * puffy (~puffy@c-71-198-18-187.hsd1.ca.comcast.net) Quit ()
[6:50] * puffy (~puffy@c-71-198-18-187.hsd1.ca.comcast.net) has joined #ceph
[6:50] * puffy (~puffy@c-71-198-18-187.hsd1.ca.comcast.net) Quit ()
[6:55] * onyb (~ani07nov@112.133.232.17) has joined #ceph
[6:57] <badone> hellertime: do you need it? Maybe you could just blow it away and add it anew?
[6:57] * matj345314 (~matj34531@element.planetq.org) has joined #ceph
[6:57] <badone> unless you want to investigate the issue of course
[6:59] <hellertime> I'm ok removing it. now how to remove it isn't something I've done before...
[6:59] * vikhyat (~vumrao@121.244.87.116) has joined #ceph
[7:02] * jermudgeon (~jhaustin@tab.biz.whitestone.link) Quit (Quit: jermudgeon)
[7:03] * jermudgeon (~jhaustin@tab.biz.whitestone.link) has joined #ceph
[7:04] * matj345314 (~matj34531@element.planetq.org) Quit (Quit: matj345314)
[7:09] * deepthi (~deepthi@106.216.188.224) has joined #ceph
[7:10] * IvanJobs (~ivanjobs@103.50.11.146) Quit (Remote host closed the connection)
[7:11] * ram (~oftc-webi@static-202-65-140-146.pol.net.in) Quit (Ping timeout: 480 seconds)
[7:11] * TomasCZ (~TomasCZ@yes.tenlab.net) Quit (Quit: Leaving)
[7:14] * linuxkidd (~linuxkidd@ip70-189-207-54.lv.lv.cox.net) Quit (Quit: Leaving)
[7:16] * narthollis (~EdGruberm@7V7AAFVWJ.tor-irc.dnsbl.oftc.net) Quit ()
[7:16] * isaxi (~capitalth@192.42.115.101) has joined #ceph
[7:25] * praveen_ (~praveen@122.171.101.185) Quit (Remote host closed the connection)
[7:26] * xinxinsh (~xinxinsh@112.64.141.50) has joined #ceph
[7:31] * rdas (~rdas@121.244.87.116) has joined #ceph
[7:35] * adun153 (~adun153@49.144.43.219) has joined #ceph
[7:36] <adun153> Hi, could somebody point me to a document, or tell me how to properly restart a monitor? I just copied a new ceph.conf to my monitor node, and I'd like to have it reload the new settings. I couldn't find the documentation for that, somehow.
[7:38] * mhuang (~mhuang@42.120.74.106) has joined #ceph
[7:40] <DaveOD> adun153: what os are you using?
[7:40] <adun153> Dave00, Ubuntu 16.04
[7:41] * IvanJobs (~ivanjobs@103.50.11.146) has joined #ceph
[7:41] <DaveOD> service ceph-mon@server restart
[7:42] <DaveOD> $ ls -alh /etc/init.d/ | grep -i ceph
[7:42] <DaveOD> to find the correct name of the daemon
[7:42] <adun153> I run this from my admin node, or from where the monitor is running?
[7:42] * evelu (~erwan@2a01:e34:eecb:7400:4eeb:42ff:fedc:8ac) Quit (Ping timeout: 480 seconds)
[7:42] <DaveOD> where the monitor is running
[7:43] <adun153> root@Storage-01:/etc/init# ls -alh /etc/init.d/ | grep -i ceph
[7:43] <adun153> -rwxr-xr-x 1 root root 16K May 13 17:30 ceph
[7:43] <adun153> root@Storage-01:/etc/init#
[7:43] <DaveOD> ceph status | grep monmap
[7:44] <DaveOD> what's the output?
[7:44] <adun153> root@Storage-01:/etc/init# ceph status | grep monmap
[7:44] <adun153> monmap e1: 1 mons at {Storage-01=192.168.0.30:6789/0}
[7:45] <DaveOD> service ceph restart mon.Storage-01
[7:45] <DaveOD> service ceph status mon.Storage-01
[7:46] * isaxi (~capitalth@7V7AAFVXF.tor-irc.dnsbl.oftc.net) Quit ()
[7:46] * Kakeru (~mason@06SAADOF6.tor-irc.dnsbl.oftc.net) has joined #ceph
[7:47] <adun153> root@Storage-01:/etc/init# service ceph status mon.Storage-01
[7:47] <adun153> ??? ceph.service - LSB: Start Ceph distributed file system daemons at boot time
[7:47] <adun153> Loaded: loaded (/etc/init.d/ceph; bad; vendor preset: enabled)
[7:47] <adun153> Active: active (exited) since Wed 2016-06-08 01:46:31 EDT; 25s ago
[7:47] <adun153> Docs: man:systemd-sysv-generator(8)
[7:47] <adun153> Process: 1339 ExecStart=/etc/init.d/ceph start (code=exited, status=0/SUCCESS)
[7:47] <adun153> Jun 08 01:46:29 Storage-01 systemd[1]: Starting LSB: Start Ceph distributed file system daemons at boot time...
[7:47] <adun153> Jun 08 01:46:31 Storage-01 systemd[1]: Started LSB: Start Ceph distributed file system daemons at boot time.
[7:47] <adun153> Does the " 25s ago" tell me that it was Active since 25s ago?
[7:48] <DaveOD> yes
[7:48] * matj345314 (~matj34531@cgn-nat-188-64-25-192.simobil.net) has joined #ceph
[7:48] <DaveOD> ps aux | grep ceph
[7:48] <DaveOD> how does that look on that mon server?
[7:50] <adun153> I see.
[7:51] * adun153 (~adun153@49.144.43.219) Quit (Read error: Connection reset by peer)
[7:52] * adun153 (~adun153@49.144.43.219) has joined #ceph
[7:52] <adun153> Sorry, got disconnected.
[7:52] <adun153> Then I read from somewhere that I should have added "osd crush chooseleaf type = 0"
[7:53] <hellertime> well this. is just a problem that wont end. I had some stuck pgs, a query pointed at some down OSD. so I marked them lost. but the pgs are still blocked due to the now lost OSD :/
[7:53] <adun153> If I wated to run it in single-node mode, so it wouldn't be "degraded", since I wanted "osd pool default size = 2"
[7:53] <adun153> *wnted
[7:53] <adun153> *wanted
[7:53] <adun153> So I updated ceph.conf on my admin node, did a "ceph-deploy --overwrite-config admin Storage-01" to push the new config to Storage-01.
[7:54] <adun153> Now I've restarted the monitor daemon properly, I guess. Do I need to restart the OSD daemons as well?
[7:55] <adun153> Since doing "ceph -w" still gives me:
[7:55] <adun153> 171/342 objects degraded (50.000%)
[7:55] <adun153> 54 active+undersized+degraded
[7:55] <adun153> 50 active
[7:55] <adun153> DaveOD, any thoughts on this?
[7:55] * xinxinsh (~xinxinsh@112.64.141.50) Quit (Read error: Connection reset by peer)
[7:55] * xinxinsh (~xinxinsh@112.64.141.50) has joined #ceph
[7:56] * matj345314 (~matj34531@cgn-nat-188-64-25-192.simobil.net) Quit (Quit: matj345314)
[7:57] <DaveOD> adun153: ceph status | grep osdmap
[7:57] <DaveOD> are all your OSD's up?
[7:57] <adun153> osdmap e39: 6 osds: 6 up, 6 in; 50 remapped pgs
[7:57] <adun153> flags sortbitwise
[7:58] <adun153> Yes, looks like it.
[7:58] <DaveOD> ceph -w
[7:58] <DaveOD> does it show you it's trying to recover?
[7:59] * EinstCrazy (~EinstCraz@58.247.119.250) Quit (Remote host closed the connection)
[7:59] <adun153> osdmap e39: 6 osds: 6 up, 6 in; 50 remapped pgs
[7:59] <adun153> flags sortbitwise
[7:59] * EinstCrazy (~EinstCraz@58.247.119.250) has joined #ceph
[7:59] <adun153> Sorry, wrong paste.
[7:59] * EinstCrazy (~EinstCraz@58.247.119.250) Quit (Remote host closed the connection)
[7:59] <adun153> health HEALTH_WARN
[7:59] <adun153> 54 pgs degraded
[7:59] <adun153> 104 pgs stuck unclean
[7:59] <adun153> 54 pgs undersized
[7:59] <adun153> recovery 171/342 objects degraded (50.000%)
[7:59] <adun153> too few PGs per OSD (17 < min 30)
[7:59] <adun153> Looks like it isn't recovering.
[7:59] * agsha (~agsha@121.244.155.11) has joined #ceph
[8:00] <DaveOD> sorry g2g, meeting
[8:00] <adun153> Alright
[8:00] <adun153> thanks
[8:05] * EinstCrazy (~EinstCraz@58.247.117.134) has joined #ceph
[8:06] * Lokta (~Lokta@carbon.coe.int) has joined #ceph
[8:09] <xiucai> can a pool tiers different pools at the same time ?
[8:11] * karnan (~karnan@121.244.87.117) has joined #ceph
[8:12] * DLange_ is now known as DLange
[8:13] * overclk (~quassel@121.244.87.117) has joined #ceph
[8:14] * xinxinsh (~xinxinsh@112.64.141.50) Quit (Read error: Connection reset by peer)
[8:14] * xinxinsh (~xinxinsh@112.64.141.50) has joined #ceph
[8:15] * branto (~branto@ip-78-102-208-181.net.upcbroadband.cz) has joined #ceph
[8:16] * Kakeru (~mason@06SAADOF6.tor-irc.dnsbl.oftc.net) Quit ()
[8:16] * Skyrider (~Xylios@tor01.zencurity.dk) has joined #ceph
[8:21] * xinxinsh_ (~xinxinsh@112.64.141.50) has joined #ceph
[8:21] * dgurtner (~dgurtner@178.197.228.110) has joined #ceph
[8:24] * swami1 (~swami@49.44.57.243) has joined #ceph
[8:28] * xinxinsh (~xinxinsh@112.64.141.50) Quit (Ping timeout: 480 seconds)
[8:29] * xinxinsh_ (~xinxinsh@112.64.141.50) Quit (Ping timeout: 480 seconds)
[8:31] * praveen (~praveen@121.244.155.9) has joined #ceph
[8:32] * matj345314 (~matj34531@141.255.254.208) has joined #ceph
[8:37] * dugravot6 (~dugravot6@194.199.223.4) Quit (Ping timeout: 480 seconds)
[8:37] * dugravot6 (~dugravot6@nat-persul-plg.wifi.univ-lorraine.fr) has joined #ceph
[8:39] * wjw-freebsd2 (~wjw@176.74.240.9) Quit (Ping timeout: 480 seconds)
[8:40] * kawa2014 (~kawa@89.184.114.246) has joined #ceph
[8:44] * liiwi_ is now known as liiwi
[8:46] * Skyrider (~Xylios@4MJAAF5S4.tor-irc.dnsbl.oftc.net) Quit ()
[8:46] * nicatronTg1 (~Scymex@exit1.ipredator.se) has joined #ceph
[8:52] * owasserm (~owasserm@2001:984:d3f7:1:5ec5:d4ff:fee0:f6dc) has joined #ceph
[8:52] * owasserm (~owasserm@2001:984:d3f7:1:5ec5:d4ff:fee0:f6dc) Quit ()
[8:53] * secate (~Secate@dsl-197-245-164-90.voxdsl.co.za) Quit (Quit: leaving)
[8:54] * jermudgeon (~jhaustin@tab.biz.whitestone.link) Quit (Quit: jermudgeon)
[8:56] * lmb (~Lars@charybdis-ext.suse.de) has joined #ceph
[8:57] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[8:58] * IvanJobs (~ivanjobs@103.50.11.146) Quit (Remote host closed the connection)
[8:59] * EinstCra_ (~EinstCraz@58.247.117.134) has joined #ceph
[9:00] * sbfox (~Adium@192.235.146.98) Quit (Quit: Leaving.)
[9:03] * mohmultihouse (~mohmultih@gw01.mhitp.dk) has joined #ceph
[9:05] * itamarl is now known as Guest3671
[9:05] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[9:05] * EinstCra_ (~EinstCraz@58.247.117.134) Quit (Remote host closed the connection)
[9:05] * EinstCra_ (~EinstCraz@58.247.117.134) has joined #ceph
[9:05] * Guest3671 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[9:05] * allaok (~allaok@machine107.orange-labs.com) has joined #ceph
[9:06] * EinstCrazy (~EinstCraz@58.247.117.134) Quit (Ping timeout: 480 seconds)
[9:06] * allaok (~allaok@machine107.orange-labs.com) Quit ()
[9:06] * allaok (~allaok@machine107.orange-labs.com) has joined #ceph
[9:06] * allaok (~allaok@machine107.orange-labs.com) has left #ceph
[9:06] * smerz (~ircircirc@37.74.194.90) has joined #ceph
[9:09] * rakeshgm (~rakesh@121.244.87.117) has joined #ceph
[9:10] * IvanJobs (~ivanjobs@103.50.11.146) has joined #ceph
[9:10] * Be-El (~blinke@nat-router.computational.bio.uni-giessen.de) has joined #ceph
[9:11] * hellertime (~Adium@pool-173-48-155-219.bstnma.fios.verizon.net) Quit (Quit: Leaving.)
[9:12] <The_Ball> Can anyone see an issue with this CRUSH map? I've increased "set_choose_tries" to 150 to allow all mappings to succeed, but I'm still seeing one PG with 4 degraded objects: http://paste.debian.net/725489/
[9:14] * lmb (~Lars@charybdis-ext.suse.de) Quit (Ping timeout: 480 seconds)
[9:14] * itamarl is now known as Guest3673
[9:14] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[9:16] * nicatronTg1 (~Scymex@06SAADOID.tor-irc.dnsbl.oftc.net) Quit ()
[9:16] * Uniju1 (~SEBI@tor-exit.insane.us.to) has joined #ceph
[9:17] * Guest3673 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[9:17] * wjw-freebsd (~wjw@176.74.240.9) has joined #ceph
[9:18] * linjan (~linjan@86.62.112.22) has joined #ceph
[9:18] * analbeard (~shw@support.memset.com) has joined #ceph
[9:21] * itamarl is now known as Guest3676
[9:21] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[9:22] * Guest3676 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[9:24] * thomnico (~thomnico@2a01:e35:8b41:120:f00e:d5da:e30c:c876) has joined #ceph
[9:26] * itamarl is now known as Guest3677
[9:26] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[9:27] * joshd1 (~jdurgin@71-92-201-212.dhcp.gldl.ca.charter.com) has joined #ceph
[9:29] * mistur (~yoann@kewl.mistur.org) Quit (Quit: Changing server)
[9:29] * Guest3677 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[9:30] * penguinRaider (~KiKo@204.152.207.173) Quit (Ping timeout: 480 seconds)
[9:31] <flaf> The_Ball: I'm sorry I have no idea concerning your crush map but can tell me where I can find info about this parameter set_choose_tries? I don't find in the doc.
[9:33] <The_Ball> flaf, http://docs.ceph.com/docs/jewel/rados/troubleshooting/troubleshooting-pg/
[9:34] * itamarl is now known as Guest3679
[9:34] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[9:34] * Guest3679 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[9:37] <flaf> The_Ball: thx. I guess your problem concerns a pool which uses the rule "erasure-code". I'm unqualified in erasure-code but the rest seems to me ok.
[9:38] * itamarl is now known as Guest3680
[9:38] <The_Ball> I assume it's related to the erasure-code pool, because it happened after I increased the PG/PGPs in the erasure-coded pool
[9:39] * viisking (~viisking@183.80.255.12) has joined #ceph
[9:39] <viisking> Hi all
[9:39] <flaf> The_Ball: it's possible to check that (but it's sure) with the id of the pg.
[9:39] * mistur (~yoann@kewl.mistur.org) has joined #ceph
[9:39] <viisking> when I start radosgw service, it said Cannot find zone id= (name=), switching to local zonegroup configuration
[9:39] <viisking> Couldn't init storage provider (RADOS)
[9:40] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[9:40] <viisking> is there anyone could help me ?
[9:42] <The_Ball> flaf, ceph pg map 8.3c -> osdmap e5834 pg 8.3c (8.3c) -> up [8,0] acting [8,0]
[9:42] <The_Ball> flaf, It's only mapping to two OSDs which is the issue I believe
[9:42] * Guest3680 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[9:42] <flaf> The_Ball: 8.3c so the pool is the pool with id == 8.
[9:43] <The_Ball> flaf, oh!
[9:43] <The_Ball> pool 8 'fsmetadata' replicated size 3 min_size 2 crush_ruleset 0 object_hash rjenkins pg_num 64 pgp_num 64 last_change 5715 flags hashpspool stripe_width 0
[9:43] <flaf> ceph osd lspools
[9:43] <flaf> ah...
[9:43] <The_Ball> That's just a cephfs data pool I tried out
[9:43] <The_Ball> I can delete that however, but a bit strange
[9:44] <flaf> Interesting, it's a replicated pool, no erasure-code here...
[9:44] <The_Ball> Correct, I assumed it was a problem with the ec pool because I increased PG/PGPs on that pool
[9:44] <The_Ball> I did play with cephfs while it rebuilt, so that's when it happened
[9:45] <flaf> Do you have N OSD hosts with N > 2?
[9:45] <The_Ball> I have three hosts with three OSDs each
[9:45] * itamarl is now known as Guest3682
[9:45] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[9:46] <flaf> In this case, it's curious because according to me you ruleset 0 is correct.
[9:46] * Uniju1 (~SEBI@4MJAAF5WB.tor-irc.dnsbl.oftc.net) Quit ()
[9:46] <flaf> Of course, if you don't use cephfs, you should remove it.
[9:47] <flaf> Ah The_Ball, can you paste ???ceph osd tree????
[9:47] <The_Ball> oh dear, crushtool -i crush.map --test --show-bad-mappings --rule 0 --num-rep 3 --min-x 10 --max-x $((1024 * 1024))
[9:47] <The_Ball> is showing lots of bad mapping rules
[9:48] <flaf> I didn't know this command...
[9:48] * Guest3682 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[9:48] <The_Ball> there's an excellent guide here: http://docs.ceph.com/docs/jewel/rados/troubleshooting/troubleshooting-pg/
[9:50] <The_Ball> awesome, injected a new crush map, repair started and now clean
[9:51] <The_Ball> badone, thanks for you help yesterday, sorted now :D
[9:51] <flaf> Cool. But in fact what did you do to solve this problem?
[9:51] * itamarl is now known as Guest3683
[9:51] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[9:52] <The_Ball> flaf, I had to increase the "step set_choose_tries"
[9:52] <The_Ball> I had done so for the erasure coding rule as I assumed it was the problem, it the replicated ruleset however
[9:53] * Guest3683 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[9:54] <flaf> Ok but what changes have you made with this ruleset?
[9:55] * ade (~abradshaw@85.158.226.30) has joined #ceph
[9:56] * itamarl is now known as Guest3684
[9:56] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[9:58] <flaf> The_Ball: ^^
[9:58] * dvanders (~dvanders@130.246.253.64) has joined #ceph
[9:59] * Guest3684 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[10:00] <The_Ball> flaf, I had to increase the "step set_choose_tries", so I set it to 100, I think the default is 50
[10:01] * sickolog1 (~mio@vpn.bcs.hr) Quit (Read error: Connection reset by peer)
[10:01] * itamarl is now known as Guest3685
[10:01] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[10:02] <flaf> The_Ball: ah ok, it's curious because it concerns the erasure-code not the replicated_ruleset.
[10:03] * fdmanana (~fdmanana@2001:8a0:6e0c:6601:9135:a55b:27ec:cc48) has joined #ceph
[10:03] * allaok (~allaok@machine107.orange-labs.com) has joined #ceph
[10:03] <The_Ball> flaf, why do you say that, looks like it's not related to just ec rulesets
[10:04] * allaok (~allaok@machine107.orange-labs.com) has left #ceph
[10:04] * derjohn_mob (~aj@p578b6aa1.dip0.t-ipconnect.de) Quit (Ping timeout: 480 seconds)
[10:04] * Guest3685 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[10:05] * allaok (~allaok@machine107.orange-labs.com) has joined #ceph
[10:06] * itamarl is now known as Guest3686
[10:06] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[10:06] * T1w (~jens@node3.survey-it.dk) has joined #ceph
[10:07] * zigo_ is now known as zigo
[10:07] <flaf> The_Ball: If I see you crush map, the set_choose_tries in your ruleset erasure-code, not in your ruleset "replicated_ruleset", no?
[10:07] * NTTEC (~nttec@203.177.235.23) Quit (Remote host closed the connection)
[10:07] <The_Ball> correct, and I still had the issue because the problem was with the other ruleset, now I added the set_choose_tries to the other ruleset and that fixed the issue
[10:08] <flaf> Ah ok, I understand now. Thx.
[10:08] * rendar (~I@host249-32-dynamic.37-79-r.retail.telecomitalia.it) has joined #ceph
[10:09] <flaf> Glad if your cluster is HELTH_OK now. ;)
[10:09] * Guest3686 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[10:11] * penguinRaider (~KiKo@14.139.82.6) has joined #ceph
[10:11] * evelu (~erwan@46.231.131.178) has joined #ceph
[10:11] * rraja (~rraja@121.244.87.117) has joined #ceph
[10:11] * sickology (~mio@vpn.bcs.hr) has joined #ceph
[10:11] * itamarl is now known as Guest3687
[10:11] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[10:13] * bara (~bara@nat-pool-brq-t.redhat.com) has joined #ceph
[10:14] * Guest3687 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[10:15] * allaok (~allaok@machine107.orange-labs.com) Quit (Quit: Leaving.)
[10:15] * allaok (~allaok@machine107.orange-labs.com) has joined #ceph
[10:15] * EinstCra_ (~EinstCraz@58.247.117.134) Quit (Remote host closed the connection)
[10:16] * Frostshifter (~nartholli@93.115.95.201) has joined #ceph
[10:18] * EinstCrazy (~EinstCraz@58.247.119.250) has joined #ceph
[10:19] * viisking (~viisking@183.80.255.12) Quit (Quit: Leaving)
[10:26] * joshd1 (~jdurgin@71-92-201-212.dhcp.gldl.ca.charter.com) Quit (Quit: Leaving.)
[10:27] * derjohn_mob (~aj@fw.gkh-setu.de) has joined #ceph
[10:29] * dugravot6 (~dugravot6@nat-persul-plg.wifi.univ-lorraine.fr) Quit (Quit: Leaving.)
[10:29] * itamarl is now known as Guest3689
[10:29] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[10:32] * Guest3689 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[10:33] * itamarl is now known as Guest3690
[10:33] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[10:34] * mnathani2 (~mnathani_@192-0-149-228.cpe.teksavvy.com) has joined #ceph
[10:35] * rotbeard (~redbeard@185.32.80.238) has joined #ceph
[10:36] * dugravot6 (~dugravot6@194.199.223.4) has joined #ceph
[10:36] * dugravot6 (~dugravot6@194.199.223.4) Quit (Remote host closed the connection)
[10:37] * Guest3690 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[10:38] * itamarl is now known as Guest3693
[10:38] * dugravot6 (~dugravot6@194.199.223.4) has joined #ceph
[10:38] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[10:38] * jcsp (~jspray@82-71-16-249.dsl.in-addr.zen.co.uk) Quit (Ping timeout: 480 seconds)
[10:41] * Guest3693 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[10:42] * flisky (~Thunderbi@210.12.157.94) has joined #ceph
[10:43] * EinstCrazy (~EinstCraz@58.247.119.250) Quit (Remote host closed the connection)
[10:43] * EinstCrazy (~EinstCraz@58.247.119.250) has joined #ceph
[10:44] * itamarl is now known as Guest3694
[10:44] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[10:45] * EinstCrazy (~EinstCraz@58.247.119.250) Quit (Remote host closed the connection)
[10:46] * rraja (~rraja@121.244.87.117) Quit (Ping timeout: 480 seconds)
[10:46] * Frostshifter (~nartholli@7V7AAFV5Q.tor-irc.dnsbl.oftc.net) Quit ()
[10:46] * Pirate (~Heliwr@192.87.28.28) has joined #ceph
[10:47] * EinstCrazy (~EinstCraz@58.247.117.134) has joined #ceph
[10:48] * Guest3694 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[10:49] * post-factum (~post-fact@vulcan.natalenko.name) Quit (Killed (NickServ (Too many failed password attempts.)))
[10:50] * post-factum (~post-fact@vulcan.natalenko.name) has joined #ceph
[10:50] * frickler_ is now known as frickler
[10:50] * itamarl is now known as Guest3696
[10:50] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[10:52] * Guest3696 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[10:54] * flisky (~Thunderbi@210.12.157.94) Quit (Ping timeout: 480 seconds)
[10:56] * skyrat (~skyrat@94.230.156.78) Quit (Ping timeout: 480 seconds)
[10:57] * rraja (~rraja@121.244.87.118) has joined #ceph
[10:57] * flisky (~Thunderbi@210.12.157.88) has joined #ceph
[11:00] * itamarl is now known as Guest3697
[11:00] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[11:02] * flisky (~Thunderbi@210.12.157.88) Quit ()
[11:02] * Guest3697 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[11:05] * allaok (~allaok@machine107.orange-labs.com) Quit (Quit: Leaving.)
[11:05] * allaok (~allaok@machine107.orange-labs.com) has joined #ceph
[11:06] * dgurtner (~dgurtner@178.197.228.110) Quit (Quit: Reconnecting)
[11:06] * dgurtner (~dgurtner@178.197.228.110) has joined #ceph
[11:09] * Gugge-47527 (gugge@92.246.2.105) Quit (Quit: Bye)
[11:11] * mhuang (~mhuang@42.120.74.106) Quit (Quit: This computer has gone to sleep)
[11:12] * madkiss (~madkiss@2001:6f8:12c3:f00f:ed21:ea62:1850:5557) Quit (Quit: Leaving.)
[11:12] * Gugge-47527 (gugge@92.246.2.105) has joined #ceph
[11:12] * itamarl is now known as Guest3699
[11:13] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[11:13] * karnan (~karnan@121.244.87.117) Quit (Ping timeout: 480 seconds)
[11:14] * jcsp (~jspray@fpc67915-sgyl29-2-0-cust4.18-2.static.cable.virginm.net) has joined #ceph
[11:16] * Guest3699 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[11:16] * Pirate (~Heliwr@4MJAAF51E.tor-irc.dnsbl.oftc.net) Quit ()
[11:16] * PierreW (~zapu@37.220.35.36) has joined #ceph
[11:17] * itamarl is now known as Guest3700
[11:17] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[11:18] <The_Ball> Does the pool value "nodelete" act as delete protection for the pool or is it related to objects in the pool?
[11:18] * EinstCrazy (~EinstCraz@58.247.117.134) Quit (Remote host closed the connection)
[11:20] <The_Ball> It's pool deletion protection, found it in a blog post, I wasn't sure from reading the documentation
[11:21] * Guest3700 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[11:21] * EinstCrazy (~EinstCraz@58.247.119.250) has joined #ceph
[11:21] <sep> probably the same i just googled to :) http://blog.widodh.nl/2015/04/protecting-your-ceph-pools-against-removal-or-property-changes
[11:22] * itamarl is now known as Guest3701
[11:22] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[11:23] * karnan (~karnan@121.244.87.117) has joined #ceph
[11:25] * Guest3701 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[11:25] * agsha (~agsha@121.244.155.11) Quit (Read error: Connection reset by peer)
[11:26] * agsha (~agsha@121.244.155.11) has joined #ceph
[11:27] * itamarl is now known as Guest3702
[11:27] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[11:30] * adun153 (~adun153@49.144.43.219) Quit (Quit: Ex-Chat)
[11:30] * Guest3702 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[11:30] <flaf> The_Ball: personally, to disallow the pool deletion I use ???mon allow pool delete = false??? in my ceph.conf.
[11:30] * penguinRaider (~KiKo@14.139.82.6) Quit (Read error: Connection reset by peer)
[11:30] * itamarl is now known as Guest3703
[11:30] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[11:31] * penguinRaider (~KiKo@14.139.82.6) has joined #ceph
[11:31] <The_Ball> flaf, didn't know about that one, thanks
[11:31] <flaf> I think you should restart the monitor after that.
[11:31] <The_Ball> sep, yes, "Imagine explaining that you just removed a 200TB pool from your storage system due to a typo in your Python code?", haha
[11:33] * dvanders (~dvanders@130.246.253.64) Quit (Remote host closed the connection)
[11:33] * penguinRaider (~KiKo@14.139.82.6) Quit (Read error: Connection reset by peer)
[11:33] * dvanders (~dvanders@130.246.253.64) has joined #ceph
[11:34] * penguinRaider (~KiKo@14.139.82.6) has joined #ceph
[11:35] * Guest3703 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[11:35] * dgurtner (~dgurtner@178.197.228.110) Quit (Ping timeout: 480 seconds)
[11:38] * itamarl is now known as Guest3704
[11:38] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[11:38] * dgurtner (~dgurtner@178.197.228.110) has joined #ceph
[11:43] * dvanders (~dvanders@130.246.253.64) Quit (Ping timeout: 480 seconds)
[11:43] * itamarl is now known as Guest3705
[11:43] * Guest3704 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[11:43] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[11:46] * PierreW (~zapu@7V7AAFV8C.tor-irc.dnsbl.oftc.net) Quit ()
[11:46] * Guest3705 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[11:49] * itamarl is now known as Guest3709
[11:49] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[11:49] * TMM (~hp@185.5.121.201) has joined #ceph
[11:53] * Guest3709 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[11:53] * itamarl is now known as Guest3710
[11:53] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[11:57] * Guest3710 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[11:58] <sep> flaf, you need to yes. it's described in the url above
[11:59] <sep> The_Ball, bad day at work yes.. '
[11:59] <sep> i had one inverse of that the first times i mad a rbd. i thought the number was bytes and not megabytes so i made a 200 PB rbd image.
[11:59] * rraja (~rraja@121.244.87.118) Quit (Ping timeout: 480 seconds)
[11:59] <sep> figured it out when mkfs took houers.
[11:59] * IvanJobs (~ivanjobs@103.50.11.146) Quit ()
[12:00] <sep> deleting the image took w
[12:00] <sep> ery long, several days
[12:00] <sep> :)
[12:01] * itamarl is now known as Guest3712
[12:01] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[12:03] * xiucai (~hualingso@124.114.71.83) Quit (Quit: Leaving)
[12:05] * Guest3712 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[12:07] * itamarl is now known as Guest3714
[12:07] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[12:07] <The_Ball> auch!
[12:09] * rraja (~rraja@121.244.87.117) has joined #ceph
[12:10] * Guest3714 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[12:12] * itamarl is now known as Guest3715
[12:12] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[12:15] * ngoswami (~ngoswami@121.244.87.116) has joined #ceph
[12:15] * Guest3715 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[12:16] * itamarl is now known as Guest3716
[12:16] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[12:16] * i_m (~ivan.miro@nat-5-carp.hcn-strela.ru) has joined #ceph
[12:20] * Guest3716 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[12:29] * winston-d_ (uid98317@id-98317.richmond.irccloud.com) Quit (Remote host closed the connection)
[12:29] * itamarl is now known as Guest3718
[12:29] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[12:33] * flisky (~Thunderbi@106.38.61.190) has joined #ceph
[12:34] * Guest3718 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[12:35] * bitserker (~toni@88.87.194.130) has joined #ceph
[12:36] * mattbenjamin1 (~mbenjamin@107-1-123-195-ip-static.hfc.comcastbusiness.net) has joined #ceph
[12:38] * winston-d_ (uid98317@richmond.irccloud.com) has joined #ceph
[12:41] * bitserker1 (~toni@88.87.194.130) Quit (Ping timeout: 480 seconds)
[12:41] * gauravbafna (~gauravbaf@49.32.0.244) has joined #ceph
[12:42] * itamarl is now known as Guest3719
[12:42] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[12:43] * bitserker1 (~toni@88.87.194.130) has joined #ceph
[12:43] * bitserker (~toni@88.87.194.130) Quit (Read error: Connection reset by peer)
[12:43] * Guest3719 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[12:43] * alexxy (~alexxy@biod.pnpi.spb.ru) Quit (Ping timeout: 480 seconds)
[12:46] * Nanobot (~nih@195-154-15-227.rev.poneytelecom.eu) has joined #ceph
[12:47] * itamarl is now known as Guest3720
[12:47] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[12:49] * dgurtner (~dgurtner@178.197.228.110) Quit (Ping timeout: 480 seconds)
[12:50] * Guest3720 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[12:53] * itamarl is now known as Guest3721
[12:53] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[12:57] * Guest3721 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[13:00] * itamarl is now known as Guest3722
[13:00] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[13:00] * gregmark (~Adium@68.87.42.115) has joined #ceph
[13:02] * xarses_ (~xarses@c-73-202-191-48.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[13:03] * Guest3722 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[13:03] * i_m (~ivan.miro@nat-5-carp.hcn-strela.ru) Quit (Ping timeout: 480 seconds)
[13:04] * vicente_ (~~vicente@125-227-238-55.HINET-IP.hinet.net) Quit (Quit: Leaving)
[13:06] * itamarl is now known as Guest3724
[13:06] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[13:08] * Guest3724 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[13:08] * bitserker1 (~toni@88.87.194.130) Quit (Ping timeout: 480 seconds)
[13:11] * penguinRaider (~KiKo@14.139.82.6) Quit (Ping timeout: 480 seconds)
[13:12] * itamarl is now known as Guest3726
[13:12] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[13:12] * karnan (~karnan@121.244.87.117) Quit (Remote host closed the connection)
[13:14] * Guest3726 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[13:14] * mohmultihouse is now known as saintpablo
[13:16] * Nanobot (~nih@4MJAAF564.tor-irc.dnsbl.oftc.net) Quit ()
[13:16] * Azru (~DoDzy@94.100.6.27) has joined #ceph
[13:17] * mattbenjamin1 (~mbenjamin@107-1-123-195-ip-static.hfc.comcastbusiness.net) Quit (Ping timeout: 480 seconds)
[13:18] * itamarl is now known as Guest3727
[13:18] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[13:19] * penguinRaider (~KiKo@204.152.207.173) has joined #ceph
[13:20] * Guest3727 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[13:22] * Tene (~tene@173.13.139.236) Quit (Ping timeout: 480 seconds)
[13:22] * dgurtner (~dgurtner@178.197.228.110) has joined #ceph
[13:23] * deepthi (~deepthi@106.216.188.224) Quit (Ping timeout: 480 seconds)
[13:26] * vikhyat (~vumrao@121.244.87.116) Quit (Remote host closed the connection)
[13:26] * vikhyat (~vumrao@121.244.87.116) has joined #ceph
[13:27] * itamarl is now known as Guest3730
[13:27] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[13:28] * DV (~veillard@2001:41d0:a:f29f::1) Quit (Remote host closed the connection)
[13:28] * flisky (~Thunderbi@106.38.61.190) Quit (Ping timeout: 480 seconds)
[13:30] * b0e (~aledermue@213.95.25.82) has joined #ceph
[13:30] * Guest3730 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[13:31] * DV (~veillard@2001:41d0:a:f29f::1) has joined #ceph
[13:31] * Tene (~tene@173.13.139.236) has joined #ceph
[13:31] * mookins_ (~mookins@induct3.lnk.telstra.net) has joined #ceph
[13:32] * deepthi (~deepthi@106.216.188.224) has joined #ceph
[13:33] * itamarl is now known as Guest3732
[13:33] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[13:35] * Guest3732 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[13:38] * thomnico (~thomnico@2a01:e35:8b41:120:f00e:d5da:e30c:c876) Quit (Ping timeout: 480 seconds)
[13:40] * owasserm (~owasserm@2001:984:d3f7:1:5ec5:d4ff:fee0:f6dc) has joined #ceph
[13:40] * mookins_ (~mookins@induct3.lnk.telstra.net) Quit ()
[13:41] * gauravba_ (~gauravbaf@49.44.57.225) has joined #ceph
[13:43] * gauravbafna (~gauravbaf@49.32.0.244) Quit (Read error: Connection reset by peer)
[13:43] * gauravbafna (~gauravbaf@49.32.0.244) has joined #ceph
[13:43] * rwheeler (~rwheeler@pool-173-48-195-215.bstnma.fios.verizon.net) Quit (Quit: Leaving)
[13:44] * b0e (~aledermue@213.95.25.82) Quit (Ping timeout: 480 seconds)
[13:45] * itamarl is now known as Guest3733
[13:45] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[13:45] * Guest3733 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[13:45] * gauravbafna (~gauravbaf@49.32.0.244) Quit (Remote host closed the connection)
[13:46] * Azru (~DoDzy@06SAADOUC.tor-irc.dnsbl.oftc.net) Quit ()
[13:46] * thomnico (~thomnico@2a01:e35:8b41:120:940e:a463:f09e:6c27) has joined #ceph
[13:46] * W|ldCraze (~Pulec@195.12.190.38) has joined #ceph
[13:48] * hellertime (~Adium@pool-173-48-155-219.bstnma.fios.verizon.net) has joined #ceph
[13:50] * gauravba_ (~gauravbaf@49.44.57.225) Quit (Ping timeout: 480 seconds)
[13:52] * itamarl is now known as Guest3734
[13:52] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[13:52] * chengpeng (~chris@180.168.126.243) Quit (Quit: Leaving)
[13:53] * Guest3734 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[13:55] * xarses (~xarses@216.9.110.4) has joined #ceph
[13:56] * b0e (~aledermue@213.95.25.82) has joined #ceph
[13:58] * gregmark (~Adium@68.87.42.115) Quit (Quit: Leaving.)
[14:01] * itamarl is now known as Guest3735
[14:01] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[14:03] * i_m (~ivan.miro@deibp9eh1--blueice2n0.emea.ibm.com) has joined #ceph
[14:04] * Guest3735 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[14:05] * itamarl is now known as Guest3736
[14:05] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[14:06] * bvi (~Bastiaan@185.56.32.1) has joined #ceph
[14:07] * MrAbaddon (~MrAbaddon@193.137.26.66) has joined #ceph
[14:09] * lmb (~Lars@charybdis-ext.suse.de) has joined #ceph
[14:09] * Guest3736 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[14:12] * itamarl is now known as Guest3737
[14:12] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[14:12] * Hemanth (~hkumar_@121.244.87.117) has joined #ceph
[14:13] * Guest3737 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[14:14] * EinstCrazy (~EinstCraz@58.247.119.250) Quit (Remote host closed the connection)
[14:14] * wgao (~wgao@106.120.101.38) Quit (Ping timeout: 480 seconds)
[14:14] * EinstCrazy (~EinstCraz@58.247.119.250) has joined #ceph
[14:15] * i_m (~ivan.miro@deibp9eh1--blueice2n0.emea.ibm.com) Quit (Quit: Leaving.)
[14:15] * i_m (~ivan.miro@deibp9eh1--blueice2n1.emea.ibm.com) has joined #ceph
[14:16] * W|ldCraze (~Pulec@06SAADOVQ.tor-irc.dnsbl.oftc.net) Quit ()
[14:16] * wgao (~wgao@106.120.101.38) has joined #ceph
[14:16] * Dinnerbone (~Schaap@torproxy02.31173.se) has joined #ceph
[14:17] * lmb (~Lars@charybdis-ext.suse.de) Quit (Ping timeout: 480 seconds)
[14:17] * mattbenjamin1 (~mbenjamin@23.30.145.165) has joined #ceph
[14:20] * batoski (~batoski@14.33.3.227) has joined #ceph
[14:20] <hellertime> hmm. it seems my version of ceph doesnt have cephfs-data-scan...
[14:20] * itamarl (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[14:20] <hellertime> is that tool backwards compatible?
[14:21] <hellertime> can I find it in a newer version than hammer?
[14:21] <jcsp> hellertime: yes, you need to be using >= jewel for any of that stuff
[14:21] <batoski> hi guys.. i need help
[14:22] * EinstCrazy (~EinstCraz@58.247.119.250) Quit (Ping timeout: 480 seconds)
[14:23] <hellertime> jscp: will it work with a filesystem created using hammer though? or did the fs format change and it will just make things worse? (I've got some missing directory objects due to an OSD outage??? hoping to recover the metadata)
[14:23] <batoski> how to change makefile?
[14:24] * neurodrone_ (~neurodron@162.243.191.67) has joined #ceph
[14:25] <jcsp> hellertime: hmm, I can't think of any fundamental incompatabilities off the top of my head in terms of reading the existing objects
[14:25] <jcsp> *but* the repair tools will write jewel-versioned structures to disk that a hammer MDS won't understand
[14:25] <jcsp> so if you use jewel repair tools you'll also need to upgrade to jewel overall at the same time
[14:26] <hellertime> crap
[14:26] <hellertime> :)
[14:26] <jcsp> cephfs-data-scan also uses an OSD feature that is only present in jewel to scan things efficiently, it will use a much slower fallback otherwise
[14:26] * karnan (~karnan@106.51.128.50) has joined #ceph
[14:26] <jcsp> long story short, you need jewel
[14:26] * allaok (~allaok@machine107.orange-labs.com) has left #ceph
[14:26] <hellertime> yeah??? unfortunately that won't be an easy sell at the moment >:(
[14:26] <hellertime> ok
[14:28] <flaf> Question: I have noticed there are many logs for the MDS in "standby-replay" state.
[14:28] <flaf> I have every seconds the 2 same lines ???mds.0.0 standby_replay_restart (as standby)??? and ???mds.0.0 replay_done (as standby)???. IS it normal?
[14:30] <flaf> If yes, I can disable it?
[14:32] <jcsp> flaf: hmm, I think that's normal but we possible should decrease the log level on that message
[14:32] <jcsp> it's currently in as "1" which is usually for significant/error-ish things
[14:32] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[14:33] * kefu (~kefu@114.92.104.47) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[14:33] <flaf> Ah it could be an good idea. Because it wastes the logs imho.
[14:34] <flaf> jcsp: since Jewel, the ???ceph mds dump??? command doesn't list the mds in "standby" state. Is it normal? It was the case in Infernalis for instance.
[14:35] <flaf> I found that handy but it's a detail.
[14:35] <jcsp> flaf: now that we have multiple filesystems "mds dump" is only telling you about one filesystem (it's in there for backward compatibility)
[14:35] <jcsp> standbys aren't associated with a filesystem, so they don't appear there
[14:35] <jcsp> but you can see them in "fs dump"
[14:36] * itamarl is now known as Guest3742
[14:36] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[14:36] <flaf> Ah perfect. Are multiple cephfs stable in Jewel?
[14:37] * Dinnerbone (~Schaap@06SAADOXF.tor-irc.dnsbl.oftc.net) Quit (Remote host closed the connection)
[14:37] <jcsp> it's a brand new feature, so it's considered experimental and disabled by default
[14:37] <flaf> Ok.
[14:38] <jcsp> but it's almost entirely a mon change (MDSs just use whatever FS the mon tells them to), so if you try it out and it seems to work, then you're probably fine
[14:38] <jcsp> the client support was definitely a bit buggy in the first jewel release though
[14:39] <flaf> ah ok, interesting...
[14:40] * bitserker (~toni@88.87.194.130) has joined #ceph
[14:40] <flaf> Thx for the answers jcsp. Concerning the logs of MDS in "standby-replay state, it seems to me a good idea to decrease the log level. ;)
[14:40] * Guest3742 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[14:40] <flaf> (decrease the logs level just for the messages quoted above of course ;))
[14:42] * itamarl is now known as Guest3743
[14:42] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[14:43] * dyasny (~dyasny@cable-192.222.152.136.electronicbox.net) Quit (Ping timeout: 480 seconds)
[14:44] * Guest3743 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[14:45] * bvi (~Bastiaan@185.56.32.1) Quit (Ping timeout: 480 seconds)
[14:47] * itamarl is now known as Guest3744
[14:47] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[14:48] * onyb (~ani07nov@112.133.232.17) Quit (Quit: raise SystemExit())
[14:49] * batoski (~batoski@14.33.3.227) has left #ceph
[14:49] * gregmark (~Adium@68.87.42.115) has joined #ceph
[14:50] * Guest3744 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[14:51] * mhack (~mhack@23.30.145.165) has joined #ceph
[14:51] * johnavp19891 (~jpetrini@pool-100-14-10-2.phlapa.fios.verizon.net) Quit (Ping timeout: 480 seconds)
[14:52] * itamarl is now known as Guest3746
[14:52] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[14:53] * xarses (~xarses@216.9.110.4) Quit (Ping timeout: 480 seconds)
[14:54] * bene (~bene@nat-pool-bos-t.redhat.com) has joined #ceph
[14:55] * Guest3746 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[14:56] * swami2 (~swami@49.44.57.243) has joined #ceph
[14:57] * itamarl is now known as Guest3748
[14:57] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[14:58] * vbellur (~vijay@71.234.224.255) Quit (Ping timeout: 480 seconds)
[14:58] * bniver (~bniver@2600:1000:b03d:e765:1914:14f1:6fa1:b7f4) has joined #ceph
[14:59] * swami1 (~swami@49.44.57.243) Quit (Ping timeout: 480 seconds)
[15:00] * Guest3748 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[15:00] * mkoderer (uid11949@id-11949.ealing.irccloud.com) has joined #ceph
[15:02] <mkoderer> scuttlemonkey: ping
[15:02] * georgem (~Adium@206.108.127.16) has joined #ceph
[15:02] * deepthi (~deepthi@106.216.188.224) Quit (Quit: Leaving)
[15:02] <mkoderer> scuttlemonkey: do you know why the metrics doesn't really work? http://metrics.ceph.com/scm-companies-summary.html?release=v0.9
[15:02] <mkoderer> at least if a certain release is selected
[15:03] * itamarl is now known as Guest3749
[15:03] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[15:04] * swami1 (~swami@49.44.57.243) has joined #ceph
[15:04] * swami2 (~swami@49.44.57.243) Quit (Ping timeout: 480 seconds)
[15:06] * Guest3749 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[15:07] * neurodrone_ (~neurodron@162.243.191.67) Quit (Quit: neurodrone_)
[15:07] * LRWerewolf (~uhtr5r@tor-exit.eecs.umich.edu) has joined #ceph
[15:07] * itamarl is now known as Guest3750
[15:07] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[15:07] * swami2 (~swami@49.44.57.243) has joined #ceph
[15:11] * Guest3750 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[15:11] * brad_mssw (~brad@66.129.88.50) has joined #ceph
[15:12] * swami1 (~swami@49.44.57.243) Quit (Ping timeout: 480 seconds)
[15:18] * gauravbafna (~gauravbaf@122.178.203.110) has joined #ceph
[15:19] * swami1 (~swami@49.44.57.243) has joined #ceph
[15:20] * gauravba_ (~gauravbaf@122.178.230.225) has joined #ceph
[15:22] * bara (~bara@nat-pool-brq-t.redhat.com) Quit (Quit: Bye guys! (??????????????????? ?????????)
[15:23] * itamarl is now known as Guest3751
[15:23] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[15:23] * swami2 (~swami@49.44.57.243) Quit (Ping timeout: 480 seconds)
[15:23] * Guest3751 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[15:25] * Hemanth (~hkumar_@121.244.87.117) Quit (Ping timeout: 480 seconds)
[15:26] * gauravbafna (~gauravbaf@122.178.203.110) Quit (Ping timeout: 480 seconds)
[15:27] * itamarl is now known as Guest3752
[15:27] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[15:31] * Guest3752 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[15:31] * itamarl is now known as Guest3753
[15:31] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[15:32] * MentalRay (~MentalRay@107.171.161.165) has joined #ceph
[15:32] * MentalRay (~MentalRay@107.171.161.165) Quit ()
[15:34] * swami2 (~swami@49.44.57.243) has joined #ceph
[15:35] * lmb (~Lars@nat.nue.novell.com) has joined #ceph
[15:35] * boolman_ (boolman@79.138.78.238) Quit (Remote host closed the connection)
[15:35] * boolman (boolman@79.138.78.238) has joined #ceph
[15:35] * Guest3753 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[15:37] * LRWerewolf (~uhtr5r@7V7AAFWKI.tor-irc.dnsbl.oftc.net) Quit ()
[15:37] * Nanobot (~blank@06SAADO12.tor-irc.dnsbl.oftc.net) has joined #ceph
[15:37] * MrAbaddon (~MrAbaddon@193.137.26.66) Quit (Ping timeout: 480 seconds)
[15:38] <georgem> anybody knows how to set ceph so it doesn't log this type of messages anymore? "2016-06-07 23:59:42.062118 7f9532380700 0 -- 172.25.16.63:6848/2005525 >> 172.25.16.23:6852/6696 pipe(0x12367000 sd=435 :6848 s=0 pgs=0 cs=0 l=0 c=0x139a7de0).accept connect_seq 81 vs existing 81 state standby"
[15:38] * gauravbafna (~gauravbaf@122.167.88.127) has joined #ceph
[15:38] * MrAbaddon (~MrAbaddon@193.137.26.66) has joined #ceph
[15:38] <georgem> I have 300K such logs everyday...
[15:38] * itamarl is now known as Guest3755
[15:38] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[15:38] * swami1 (~swami@49.44.57.243) Quit (Ping timeout: 480 seconds)
[15:39] * scg (~zscg@valis.gnu.org) has joined #ceph
[15:40] * vbellur (~vijay@23.30.145.165) has joined #ceph
[15:42] * Guest3755 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[15:43] * gauravba_ (~gauravbaf@122.178.230.225) Quit (Ping timeout: 480 seconds)
[15:43] * itamarl is now known as Guest3758
[15:43] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[15:43] * swami1 (~swami@49.44.57.243) has joined #ceph
[15:45] * swami2 (~swami@49.44.57.243) Quit (Ping timeout: 480 seconds)
[15:46] <SamYaple> georgem: are all your monitors up?
[15:46] <georgem> yes, all is good
[15:46] <SamYaple> can all hosts connect to all monitors
[15:46] <georgem> yes, everything is functional, no problems anywhere
[15:46] * Guest3758 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[15:47] * itamarl is now known as Guest3759
[15:47] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[15:47] * MrAbaddon (~MrAbaddon@193.137.26.66) Quit (Ping timeout: 480 seconds)
[15:47] <georgem> these are my settings: http://pastebin.com/PetiM0Vb
[15:47] * masteroman (~ivan@93-142-61-130.adsl.net.t-com.hr) has joined #ceph
[15:47] * yanzheng1 (~zhyan@118.116.113.63) Quit (Quit: This computer has gone to sleep)
[15:49] * johnavp1989 (~jpetrini@8.39.115.8) has joined #ceph
[15:49] <- *johnavp1989* To prove that you are human, please enter the result of 8+3
[15:49] <SamYaple> georgem: what are you running?
[15:51] * itamarl is now known as Guest3760
[15:51] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[15:51] <georgem> Hammer
[15:51] * Guest3759 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[15:52] <SamYaple> minor version?
[15:52] * wes_dillingham (~wes_dilli@140.247.242.44) has joined #ceph
[15:52] * swami1 (~swami@49.44.57.243) Quit (Ping timeout: 480 seconds)
[15:53] * T1w (~jens@node3.survey-it.dk) Quit (Ping timeout: 480 seconds)
[15:54] * masterom1 (~ivan@93-142-13-172.adsl.net.t-com.hr) Quit (Ping timeout: 480 seconds)
[15:54] <scuttlemonkey> mkoderer: ahh, good to know. I'll report it to bitergia
[15:54] <scuttlemonkey> thanks
[15:55] <georgem> 0.94.6 os OSDs
[15:55] * Guest3760 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[15:55] <georgem> but it's been like that with earlier versions
[15:55] * itamarl is now known as Guest3761
[15:55] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[15:56] * MrAbaddon (~MrAbaddon@62.48.251.6) has joined #ceph
[15:58] * sebastian-w (~quassel@212.218.8.139) has joined #ceph
[15:59] * Guest3761 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[16:00] * itamarl is now known as Guest3762
[16:00] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[16:03] * bniver (~bniver@2600:1000:b03d:e765:1914:14f1:6fa1:b7f4) Quit (Ping timeout: 480 seconds)
[16:03] * rdas (~rdas@121.244.87.116) Quit (Quit: Leaving)
[16:03] * Guest3762 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[16:05] * lmb (~Lars@nat.nue.novell.com) Quit (Ping timeout: 480 seconds)
[16:06] * MrAbaddon (~MrAbaddon@62.48.251.6) Quit (Ping timeout: 480 seconds)
[16:06] * m0zes__ (~mozes@n117m02.cis.ksu.edu) has joined #ceph
[16:07] * Nanobot (~blank@06SAADO12.tor-irc.dnsbl.oftc.net) Quit ()
[16:07] * cheese^ (~totalworm@185.100.85.236) has joined #ceph
[16:09] * vikhyat (~vumrao@121.244.87.116) Quit (Quit: Leaving)
[16:10] * danieagle (~Daniel@200-148-40-132.dsl.telesp.net.br) has joined #ceph
[16:12] * bniver (~bniver@23.30.145.165) has joined #ceph
[16:12] * wes_dillingham (~wes_dilli@140.247.242.44) Quit (Read error: Connection reset by peer)
[16:15] * bniver_ (~bniver@2600:1000:b03d:e765:1914:14f1:6fa1:b7f4) has joined #ceph
[16:17] * kefu (~kefu@114.92.104.47) has joined #ceph
[16:18] * MrAbaddon (~MrAbaddon@193.137.26.66) has joined #ceph
[16:18] * itamarl is now known as Guest3764
[16:18] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[16:18] * joelc (~joelc@rrcs-71-41-248-34.sw.biz.rr.com) has joined #ceph
[16:19] * matj345314 (~matj34531@141.255.254.208) Quit (Quit: matj345314)
[16:20] * gauravba_ (~gauravbaf@122.172.243.240) has joined #ceph
[16:22] * bniver (~bniver@23.30.145.165) Quit (Ping timeout: 480 seconds)
[16:22] * Guest3764 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[16:24] * itamarl is now known as Guest3765
[16:24] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[16:25] * gauravbafna (~gauravbaf@122.167.88.127) Quit (Ping timeout: 480 seconds)
[16:26] * Guest3765 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[16:29] * itamarl is now known as Guest3766
[16:29] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[16:30] * owasserm (~owasserm@2001:984:d3f7:1:5ec5:d4ff:fee0:f6dc) Quit (Ping timeout: 480 seconds)
[16:32] * Guest3766 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[16:33] * itamarl is now known as Guest3767
[16:33] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[16:36] * karnan (~karnan@106.51.128.50) Quit (Ping timeout: 480 seconds)
[16:36] * praveen (~praveen@121.244.155.9) Quit (Remote host closed the connection)
[16:37] * cheese^ (~totalworm@06SAADO3U.tor-irc.dnsbl.oftc.net) Quit ()
[16:37] * FNugget (~Averad@192.42.116.16) has joined #ceph
[16:37] * linjan (~linjan@86.62.112.22) Quit (Ping timeout: 480 seconds)
[16:37] * Guest3767 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[16:40] * agsha (~agsha@121.244.155.11) Quit (Remote host closed the connection)
[16:40] * MentalRay (~MentalRay@MTRLPQ42-1176054809.sdsl.bell.ca) has joined #ceph
[16:40] * ade (~abradshaw@85.158.226.30) Quit (Ping timeout: 480 seconds)
[16:41] * praveen (~praveen@121.244.155.9) has joined #ceph
[16:41] * vbellur (~vijay@23.30.145.165) Quit (Ping timeout: 480 seconds)
[16:43] * Brochacho (~alberto@c-73-45-127-198.hsd1.il.comcast.net) has joined #ceph
[16:43] * joshd1 (~jdurgin@71-92-201-212.dhcp.gldl.ca.charter.com) has joined #ceph
[16:44] * itamarl is now known as Guest3768
[16:44] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[16:44] * dnunez (~dnunez@nat-pool-bos-t.redhat.com) has joined #ceph
[16:46] * thomnico (~thomnico@2a01:e35:8b41:120:940e:a463:f09e:6c27) Quit (Ping timeout: 480 seconds)
[16:47] * mhack (~mhack@23.30.145.165) Quit (Quit: Leaving)
[16:47] * mattbenjamin1 (~mbenjamin@23.30.145.165) Quit (Ping timeout: 480 seconds)
[16:47] * Guest3768 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[16:48] * ircolle (~Adium@2601:285:201:633a:bc4e:35ee:f514:c4b2) has joined #ceph
[16:49] * praveen (~praveen@121.244.155.9) Quit (Ping timeout: 480 seconds)
[16:50] * gauravbafna (~gauravbaf@122.172.195.194) has joined #ceph
[16:50] * lmb (~Lars@nat.nue.novell.com) has joined #ceph
[16:50] * bene2 (~bene@nat-pool-bos-t.redhat.com) has joined #ceph
[16:50] * mhack (~mhack@23.30.145.165) has joined #ceph
[16:51] * wushudoin (~wushudoin@2601:646:9501:d2b2:2ab2:bdff:fe0b:a6ee) has joined #ceph
[16:51] * mhack (~mhack@23.30.145.165) Quit ()
[16:52] * wushudoin (~wushudoin@2601:646:9501:d2b2:2ab2:bdff:fe0b:a6ee) Quit ()
[16:52] * wushudoin (~wushudoin@2601:646:9501:d2b2:2ab2:bdff:fe0b:a6ee) has joined #ceph
[16:53] * itamarl is now known as Guest3769
[16:53] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[16:54] * matj345314 (~matj34531@element.planetq.org) has joined #ceph
[16:54] * bene (~bene@nat-pool-bos-t.redhat.com) Quit (Ping timeout: 480 seconds)
[16:55] * jermudgeon (~jhaustin@gw1.ttp.biz.whitestone.link) has joined #ceph
[16:56] * gauravba_ (~gauravbaf@122.172.243.240) Quit (Ping timeout: 480 seconds)
[16:56] * Guest3769 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[16:57] * linuxkidd (~linuxkidd@ip70-189-207-54.lv.lv.cox.net) has joined #ceph
[16:57] * krypto (~krypto@G68-90-105-100.sbcis.sbc.com) has joined #ceph
[16:58] * mattbenjamin1 (~mbenjamin@23.30.145.165) has joined #ceph
[16:59] * itamarl is now known as Guest3770
[16:59] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[16:59] * matj345314 (~matj34531@element.planetq.org) Quit (Quit: matj345314)
[17:00] * herrsergio (~herrsergi@ec2-107-21-210-136.compute-1.amazonaws.com) has joined #ceph
[17:01] * herrsergio is now known as Guest3771
[17:01] * Guest3770 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[17:02] * ntpttr_laptop (~ntpttr@jfdmzpr01-ext.jf.intel.com) has joined #ceph
[17:04] * bniver_ (~bniver@2600:1000:b03d:e765:1914:14f1:6fa1:b7f4) Quit (Ping timeout: 480 seconds)
[17:04] * saintpablo (~mohmultih@gw01.mhitp.dk) Quit (Ping timeout: 480 seconds)
[17:05] * jermudgeon (~jhaustin@gw1.ttp.biz.whitestone.link) Quit (Quit: jermudgeon)
[17:07] * FNugget (~Averad@7V7AAFWPP.tor-irc.dnsbl.oftc.net) Quit ()
[17:07] * Azru (~Hideous@tor-exit.boingboing.net) has joined #ceph
[17:07] * itamarl (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[17:07] * analbeard (~shw@support.memset.com) Quit (Quit: Leaving.)
[17:08] <MentalRay> anyone running openstack+ceph and played with snapshot a bit?
[17:09] * Guest3771 is now known as herrsergio
[17:10] <herrsergio> MentalRay: _o/
[17:12] <SamYaple> MentalRay: i know you
[17:12] <MentalRay> yes yes
[17:13] <MentalRay> I know you too
[17:13] <MentalRay> :p
[17:13] <MentalRay> even met you in Tokyo hehe
[17:13] <SamYaple> indeed
[17:13] <SamYaple> ive done a bit with it. do you have questions?
[17:13] <MentalRay> We run kilo but we patched our install for direct snapshot in ceph
[17:13] * vbellur (~vijay@23.30.145.165) has joined #ceph
[17:13] <SamYaple> right. i know that patch
[17:13] <MentalRay> Im just curious if you guys ever notice when you do snapshot
[17:14] <MentalRay> if the used place isnt reported correctly
[17:14] * dyasny (~dyasny@MTLXPQAK-1168109939.sdsl.bell.ca) has joined #ceph
[17:14] <MentalRay> doesnt look like its taking spaces
[17:14] <SamYaple> there were improvements to the ceph backend "used space" calculations in libery i believe
[17:15] <MentalRay> report is in ceph direct
[17:15] * praveen (~praveen@121.244.155.9) has joined #ceph
[17:15] <MentalRay> 13021 GB used
[17:15] <MentalRay> this is before anything
[17:15] <MentalRay> 13023 GB used
[17:15] <MentalRay> this is after i created a VM with 240gb storage(but its only taking the OS)
[17:16] <MentalRay> I will do a snapshot
[17:16] <MentalRay> now
[17:16] <herrsergio> they are just deltas
[17:16] <SamYaple> its CoW, it wont take up 240GB unless you fillup 240GB
[17:16] <MentalRay> yus
[17:16] <MentalRay> but snapshot?
[17:16] * karnan (~karnan@106.51.128.50) has joined #ceph
[17:16] <MentalRay> deltas too ?
[17:16] <herrsergio> you have to clone it and flat the snapshot to take space
[17:16] <SamYaple> snapshots should flatten
[17:16] <SamYaple> but how big is the base image
[17:17] <MentalRay> ubuntu is 2gb base image
[17:17] <SamYaple> seems like the numbers add up to me
[17:17] <MentalRay> yes
[17:17] <MentalRay> but
[17:17] <MentalRay> when I do a snapshot
[17:17] <MentalRay> it would flatten it no?
[17:17] <MentalRay> so the snapshot should take 240gb
[17:17] <SamYaple> no
[17:17] <MentalRay> x 3 copies
[17:17] <herrsergio> nop
[17:17] <MentalRay> ok ok
[17:17] <SamYaple> snapshot is still sparse
[17:18] * bniver_ (~bniver@2600:1000:b03d:e765:1914:14f1:6fa1:b7f4) has joined #ceph
[17:18] <SamYaple> flatten means it doesnt have a chain of things its based on (its not based on keeping your disk image around still)
[17:18] <SamYaple> not that it expands and thick provisions
[17:18] * rotbeard (~redbeard@185.32.80.238) Quit (Quit: Leaving)
[17:19] * mykola (~Mikolaj@193.93.217.33) has joined #ceph
[17:19] <MentalRay> ok ok
[17:19] <MentalRay> good to know
[17:19] <MentalRay> so it shows the bhavior Im having cool
[17:19] <MentalRay> You runned that patch in prod right SamYaple ?
[17:19] <SamYaple> it seems like it, yes. i think everything is probably working right
[17:20] <SamYaple> a while back. im on Mitaka now though
[17:20] <MentalRay> you had it on Kilo>
[17:20] <MentalRay> ?
[17:20] <SamYaple> correct
[17:20] <MentalRay> you losted your live migration feature when using the patch?
[17:20] <SamYaple> hmmm. i dont recall that happening. but i dont live migrate alot
[17:21] <MentalRay> ok ok
[17:21] <MentalRay> will be upgrading to mitaka next month anyway
[17:21] <MentalRay> but was just curious
[17:21] <MentalRay> I have another question
[17:21] <MentalRay> Receover delayed start
[17:22] * ntpttr_laptop (~ntpttr@jfdmzpr01-ext.jf.intel.com) Quit (Remote host closed the connection)
[17:22] <MentalRay> you use that flag in Ceph?
[17:22] <MentalRay> or herrsergio
[17:22] * ntpttr_laptop (~ntpttr@192.55.54.42) has joined #ceph
[17:23] <herrsergio> recovered delayed start
[17:24] <herrsergio> MentalRay: nope
[17:25] * xarses (~xarses@172.58.40.146) has joined #ceph
[17:26] * sage (~quassel@2607:f298:6050:709d:a405:f2e2:76b2:e42d) Quit (Ping timeout: 480 seconds)
[17:26] * jdillaman_ (~jdillaman@166.170.20.188) has joined #ceph
[17:27] * mhack (~mhack@23.30.145.165) has joined #ceph
[17:27] * mattbenjamin1 (~mbenjamin@23.30.145.165) Quit (Ping timeout: 480 seconds)
[17:27] * jowilkin (~jowilkin@2601:644:4000:b0bf:56ee:75ff:fe10:724e) has joined #ceph
[17:27] <MentalRay> ceph description make it sound like a cool feature
[17:27] * mhack (~mhack@23.30.145.165) Quit ()
[17:28] <MentalRay> where is you have an action that triggers a recovery it will wait so you can fix it(Like a node rebooting or other)
[17:28] <MentalRay> but the behavior seem to be that its cycling
[17:28] <MentalRay> so each cycle(when a PG recover?) it use this variable to wait
[17:31] * haomaiwang (~haomaiwan@210-129-17-7.jp-east.compute.idcfcloud.com) has joined #ceph
[17:31] * haomaiwang (~haomaiwan@210-129-17-7.jp-east.compute.idcfcloud.com) Quit (Remote host closed the connection)
[17:33] * fdmanana (~fdmanana@2001:8a0:6e0c:6601:9135:a55b:27ec:cc48) Quit (Quit: Leaving)
[17:33] * fdmanana (~fdmanana@bl12-226-64.dsl.telepac.pt) has joined #ceph
[17:34] * Skaag (~lunix@cpe-172-91-77-84.socal.res.rr.com) Quit (Quit: Leaving.)
[17:36] * reed (~reed@75-101-54-18.dsl.static.fusionbroadband.com) has joined #ceph
[17:37] * Azru (~Hideous@7V7AAFWRY.tor-irc.dnsbl.oftc.net) Quit ()
[17:37] * rushworld (~Jones@7V7AAFWT0.tor-irc.dnsbl.oftc.net) has joined #ceph
[17:37] * overclk (~quassel@121.244.87.117) Quit (Remote host closed the connection)
[17:40] * flisky (~Thunderbi@106.37.236.181) has joined #ceph
[17:41] * flisky (~Thunderbi@106.37.236.181) Quit ()
[17:43] * i_m (~ivan.miro@deibp9eh1--blueice2n1.emea.ibm.com) Quit (Ping timeout: 480 seconds)
[17:44] <georgem> SamYaple: are you running Hammer? do you see these log messages that seem informational in nature? the IP addresses are for the replication network, but Im not sure which part of the OSD code logs them and my debug levels are 0 already...
[17:45] * DV (~veillard@2001:41d0:a:f29f::1) Quit (Remote host closed the connection)
[17:46] * DV (~veillard@2001:41d0:a:f29f::1) has joined #ceph
[17:49] * matj345314 (~matj34531@element.planetq.org) has joined #ceph
[17:49] * b0e (~aledermue@213.95.25.82) Quit (Quit: Leaving.)
[17:52] * Be-El (~blinke@nat-router.computational.bio.uni-giessen.de) Quit (Quit: Leaving.)
[17:53] * ntpttr_laptop_ (~ntpttr@jfdmzpr01-ext.jf.intel.com) has joined #ceph
[17:53] * ntpttr_laptop (~ntpttr@192.55.54.42) Quit (Remote host closed the connection)
[17:55] * matj345314 (~matj34531@element.planetq.org) Quit (Quit: matj345314)
[17:55] * rakeshgm (~rakesh@121.244.87.117) Quit (Remote host closed the connection)
[17:56] * ntpttr_laptop_ (~ntpttr@jfdmzpr01-ext.jf.intel.com) Quit (Remote host closed the connection)
[17:56] * ntpttr_laptop_ (~ntpttr@192.55.54.42) has joined #ceph
[18:01] * sudocat (~dibarra@192.185.1.20) has joined #ceph
[18:01] * sage (~quassel@2607:f298:6050:709d:2c96:8ea6:6d05:6512) has joined #ceph
[18:01] <SamYaple> georgem: im using jewel. that message does seem imformational
[18:01] * ChanServ sets mode +o sage
[18:01] * oliveiradan (~doliveira@137.65.133.10) Quit (Quit: Leaving)
[18:01] * gauravbafna (~gauravbaf@122.172.195.194) Quit (Remote host closed the connection)
[18:01] <SamYaple> georgem: https://github.com/ceph/ceph/blob/hammer/src/msg/simple/Pipe.cc#L512
[18:02] <SamYaple> seems like its logging to level 0 :/
[18:03] * joelc (~joelc@rrcs-71-41-248-34.sw.biz.rr.com) Quit (Remote host closed the connection)
[18:03] * derjohn_mob (~aj@fw.gkh-setu.de) Quit (Ping timeout: 480 seconds)
[18:04] * karnan (~karnan@106.51.128.50) Quit (Ping timeout: 480 seconds)
[18:06] * joelc (~joelc@rrcs-71-41-248-34.sw.biz.rr.com) has joined #ceph
[18:07] * rushworld (~Jones@7V7AAFWT0.tor-irc.dnsbl.oftc.net) Quit ()
[18:07] * Xerati (~Fapiko@anonymous.sec.nl) has joined #ceph
[18:07] * bniver_ (~bniver@2600:1000:b03d:e765:1914:14f1:6fa1:b7f4) Quit (Ping timeout: 480 seconds)
[18:07] * jcsp (~jspray@fpc67915-sgyl29-2-0-cust4.18-2.static.cable.virginm.net) Quit (Ping timeout: 480 seconds)
[18:10] <georgem> not very useful :(
[18:11] <georgem> maybe I should try "-1" :)
[18:11] * xarses (~xarses@172.58.40.146) Quit (Ping timeout: 480 seconds)
[18:13] * xarses (~xarses@172.58.40.146) has joined #ceph
[18:15] * MrAbaddon (~MrAbaddon@193.137.26.66) Quit (Quit: Leaving)
[18:16] * kawa2014 (~kawa@89.184.114.246) Quit (Quit: Leaving)
[18:18] * gauravbafna (~gauravbaf@122.172.195.194) has joined #ceph
[18:20] * thomnico (~thomnico@81.253.36.83) has joined #ceph
[18:23] * xarses (~xarses@172.58.40.146) Quit (Ping timeout: 480 seconds)
[18:24] * gauravbafna (~gauravbaf@122.172.195.194) Quit (Remote host closed the connection)
[18:25] * gauravbafna (~gauravbaf@122.172.195.194) has joined #ceph
[18:26] * dnunez (~dnunez@nat-pool-bos-t.redhat.com) Quit (Remote host closed the connection)
[18:29] * derjohn_mob (~aj@88.128.80.100) has joined #ceph
[18:30] * thomnico (~thomnico@81.253.36.83) Quit (Quit: Ex-Chat)
[18:33] * vasu (~vasu@c-73-231-60-138.hsd1.ca.comcast.net) has joined #ceph
[18:36] * dyasny (~dyasny@MTLXPQAK-1168109939.sdsl.bell.ca) Quit (Ping timeout: 480 seconds)
[18:37] * Xerati (~Fapiko@7V7AAFWVV.tor-irc.dnsbl.oftc.net) Quit ()
[18:37] * Da_Pineapple (~Wizeon@tor-exit.squirrel.theremailer.net) has joined #ceph
[18:38] * rraja (~rraja@121.244.87.117) Quit (Quit: Leaving)
[18:39] * gauravbafna (~gauravbaf@122.172.195.194) Quit (Remote host closed the connection)
[18:43] * ngoswami (~ngoswami@121.244.87.116) Quit (Quit: Leaving)
[18:43] * sbfox (~Adium@vancouver.xmatters.com) has joined #ceph
[18:45] * Rickus (~Rickus@office.protected.ca) has joined #ceph
[18:48] * Skaag (~lunix@65.200.54.234) has joined #ceph
[18:49] * fdmanana (~fdmanana@bl12-226-64.dsl.telepac.pt) Quit (Quit: Leaving)
[18:50] * gauravbafna (~gauravbaf@122.172.195.194) has joined #ceph
[18:51] * bniver (~bniver@2600:1000:b03d:e765:1914:14f1:6fa1:b7f4) has joined #ceph
[18:53] * TomasCZ (~TomasCZ@yes.tenlab.net) has joined #ceph
[18:55] * joshd1 (~jdurgin@71-92-201-212.dhcp.gldl.ca.charter.com) Quit (Quit: Leaving.)
[18:55] * TomasCZ (~TomasCZ@yes.tenlab.net) Quit ()
[18:56] * gauravbafna (~gauravbaf@122.172.195.194) Quit (Remote host closed the connection)
[18:57] * jdillaman_ (~jdillaman@166.170.20.188) Quit (Quit: jdillaman_)
[18:58] * owasserm (~owasserm@37.153.217.1) has joined #ceph
[19:01] * swami1 (~swami@27.7.161.30) has joined #ceph
[19:02] * lmb (~Lars@nat.nue.novell.com) Quit (Ping timeout: 480 seconds)
[19:05] * linuxkidd_ (~linuxkidd@166.170.49.164) has joined #ceph
[19:05] * linuxkidd (~linuxkidd@ip70-189-207-54.lv.lv.cox.net) Quit (Ping timeout: 480 seconds)
[19:07] * Da_Pineapple (~Wizeon@06SAADPDT.tor-irc.dnsbl.oftc.net) Quit ()
[19:07] * xarses (~xarses@c-71-238-42-189.hsd1.or.comcast.net) has joined #ceph
[19:11] * ItsCriminalAFK (~JWilbur@7V7AAFWZT.tor-irc.dnsbl.oftc.net) has joined #ceph
[19:11] * dnunez (~dnunez@nat-pool-bos-u.redhat.com) has joined #ceph
[19:12] * TMM (~hp@185.5.121.201) Quit (Quit: Ex-Chat)
[19:15] * owasserm (~owasserm@37.153.217.1) Quit (Quit: Ex-Chat)
[19:19] * joelc (~joelc@rrcs-71-41-248-34.sw.biz.rr.com) Quit (Remote host closed the connection)
[19:20] * treenerd_ (~gsulzberg@cpe90-146-148-47.liwest.at) has joined #ceph
[19:20] * dnunez (~dnunez@nat-pool-bos-u.redhat.com) Quit (Ping timeout: 481 seconds)
[19:24] * danieagle (~Daniel@200-148-40-132.dsl.telesp.net.br) Quit (Quit: Obrigado por Tudo! :-) inte+ :-))
[19:27] * gauravbafna (~gauravbaf@122.172.195.194) has joined #ceph
[19:31] * vbellur (~vijay@23.30.145.165) Quit (Read error: Connection timed out)
[19:31] * derjohn_mob (~aj@88.128.80.100) Quit (Ping timeout: 480 seconds)
[19:32] * gauravbafna (~gauravbaf@122.172.195.194) Quit (Remote host closed the connection)
[19:32] * dnunez (~dnunez@nat-pool-bos-t.redhat.com) has joined #ceph
[19:34] * mattbenjamin1 (~mbenjamin@23.30.145.165) has joined #ceph
[19:35] * dgurtner (~dgurtner@178.197.228.110) Quit (Ping timeout: 480 seconds)
[19:41] * ItsCriminalAFK (~JWilbur@7V7AAFWZT.tor-irc.dnsbl.oftc.net) Quit ()
[19:41] * rapedex (~Jones@edwardsnowden1.torservers.net) has joined #ceph
[19:42] * matj345314 (~matj34531@element.planetq.org) has joined #ceph
[19:44] * gauravbafna (~gauravbaf@122.172.195.194) has joined #ceph
[19:45] * jlayton (~jlayton@2606:a000:1125:602c:c5:7ff:fe41:3227) Quit (Ping timeout: 480 seconds)
[19:48] * gauravbafna (~gauravbaf@122.172.195.194) Quit (Remote host closed the connection)
[19:49] * rwheeler (~rwheeler@172.56.23.57) has joined #ceph
[19:50] * gauravbafna (~gauravbaf@122.172.195.194) has joined #ceph
[19:51] * ngoswami (~ngoswami@1.39.14.201) has joined #ceph
[19:53] * joelc (~joelc@rrcs-71-41-248-34.sw.biz.rr.com) has joined #ceph
[19:56] * evelu (~erwan@46.231.131.178) Quit (Ping timeout: 480 seconds)
[19:57] * treenerd_ (~gsulzberg@cpe90-146-148-47.liwest.at) Quit (Quit: treenerd_)
[20:01] * ntpttr_laptop_ (~ntpttr@192.55.54.42) Quit (Remote host closed the connection)
[20:01] * gauravbafna (~gauravbaf@122.172.195.194) Quit (Remote host closed the connection)
[20:03] * ntpttr_laptop (~ntpttr@192.55.54.42) has joined #ceph
[20:05] * linuxkidd_ (~linuxkidd@166.170.49.164) Quit (Ping timeout: 480 seconds)
[20:05] * ircolle (~Adium@2601:285:201:633a:bc4e:35ee:f514:c4b2) Quit (Quit: Leaving.)
[20:06] * linuxkidd (~linuxkidd@ip70-189-207-54.lv.lv.cox.net) has joined #ceph
[20:09] * mhack (~mhack@23.30.145.165) has joined #ceph
[20:10] * matj345314 (~matj34531@element.planetq.org) Quit (Quit: matj345314)
[20:11] * rapedex (~Jones@4MJAAF6VU.tor-irc.dnsbl.oftc.net) Quit ()
[20:11] * Revo84 (~SinZ|offl@tor-exit.cappuccino.pw) has joined #ceph
[20:13] * kefu is now known as kefu|afk
[20:13] * TomasCZ (~TomasCZ@yes.tenlab.net) has joined #ceph
[20:15] * dyasny (~dyasny@cable-192.222.152.136.electronicbox.net) has joined #ceph
[20:15] * matj345314 (~matj34531@element.planetq.org) has joined #ceph
[20:17] * branto (~branto@ip-78-102-208-181.net.upcbroadband.cz) Quit (Quit: Leaving.)
[20:25] * swami1 (~swami@27.7.161.30) Quit (Quit: Leaving.)
[20:28] <evilrob_> I've got some folks on my openstack cluster requesting I add support for containers (probably openstack magnum). I'm probably limited to creating a ceph rbd for the container host. Does anyone know of a way to point docker straight into ceph?
[20:28] <evilrob_> oh... reading more... magnum creates containers inside VMs.
[20:33] * bitserker (~toni@88.87.194.130) Quit (Ping timeout: 480 seconds)
[20:36] * lcurtis (~lcurtis@47.19.105.250) has joined #ceph
[20:41] * mnathani2 (~mnathani_@192-0-149-228.cpe.teksavvy.com) Quit ()
[20:41] * Revo84 (~SinZ|offl@06SAADPJ2.tor-irc.dnsbl.oftc.net) Quit ()
[20:41] * Averad (~visored@tor-exit.gansta93.com) has joined #ceph
[20:45] * vasu (~vasu@c-73-231-60-138.hsd1.ca.comcast.net) Quit (Quit: Leaving)
[20:48] * jlayton (~jlayton@107.13.84.55) has joined #ceph
[20:52] * stiopa (~stiopa@cpc73832-dals21-2-0-cust453.20-2.cable.virginm.net) has joined #ceph
[20:54] <SamYaple> evilrob_: i believe there is a ceph backend for volumes now in docker, but other than that you have to use RBDs
[20:54] * matj345314 (~matj34531@element.planetq.org) Quit (Quit: matj345314)
[20:56] * evilrob_ is now known as evilrob
[20:57] <evilrob> they're using containers as a way to isolate dependancies. magnum should work for us with containers inside VMs. If we have to go the other way, we can use RBDs. It just won't be "pretty"
[20:59] * penguinRaider (~KiKo@204.152.207.173) Quit (Ping timeout: 480 seconds)
[21:04] * jdillaman_ (~jdillaman@166.170.20.188) has joined #ceph
[21:05] * vasu (~vasu@c-73-231-60-138.hsd1.ca.comcast.net) has joined #ceph
[21:05] * bniver (~bniver@2600:1000:b03d:e765:1914:14f1:6fa1:b7f4) Quit (Ping timeout: 480 seconds)
[21:07] <LiftedKilt> In a circumstance where I am deploying machines with 24x 1tb SSDs for OSDs, what is recommended for journaling?
[21:08] <LiftedKilt> If I put the journals on the same disk as the osds I kill my write performance by 2, and if I devote separate drives for it I likewise kill my write performance by some factor
[21:09] <LiftedKilt> it seems to me that my only reasonable options are an nvme ssd or no journal
[21:11] * derjohn_mob (~aj@x4db19959.dyn.telefonica.de) has joined #ceph
[21:11] * Averad (~visored@4MJAAF6YY.tor-irc.dnsbl.oftc.net) Quit ()
[21:11] * spate (~Quackie@7V7AAFW6I.tor-irc.dnsbl.oftc.net) has joined #ceph
[21:12] * johnavp1989 (~jpetrini@8.39.115.8) Quit (Ping timeout: 480 seconds)
[21:12] * bniver (~bniver@2600:1000:b03d:e765:1914:14f1:6fa1:b7f4) has joined #ceph
[21:12] * matj345314 (~matj34531@element.planetq.org) has joined #ceph
[21:16] * penguinRaider (~KiKo@mail2.geosansar.com) has joined #ceph
[21:20] * lmb (~Lars@tmo-102-171.customers.d1-online.com) has joined #ceph
[21:21] <SamYaple> LiftedKilt: no journal is not really option. any unexpected power outage gaurantees corrupted ceph disk
[21:21] <SamYaple> build your cluster out for more performance
[21:22] * sbfox (~Adium@vancouver.xmatters.com) Quit (Quit: Leaving.)
[21:23] * Skaag (~lunix@65.200.54.234) Quit (Quit: Leaving.)
[21:26] * georgem (~Adium@206.108.127.16) Quit (Ping timeout: 480 seconds)
[21:33] * jdillaman__ (~jdillaman@23.30.145.165) has joined #ceph
[21:33] * jdillaman_ (~jdillaman@166.170.20.188) Quit (Ping timeout: 480 seconds)
[21:36] <LiftedKilt> SamYaple: so basically just eat the performance loss?
[21:36] <LiftedKilt> and make up for it in volume
[21:37] <rkeene> Sadly. One day I dream to make a replacement for Ceph that solves some of these problems, but it'll be a lot of work to get the same features we need.
[21:38] <LiftedKilt> is 10gb of nvme journal per tb of ssd osd optimal?
[21:38] <rkeene> (I've already started, but it's months of development to get something basic (none of the features we need -- except image/file storage) but production ready)
[21:38] <m0zes__> Bluestore?
[21:38] <LiftedKilt> if so, then I can just throw a 256gb nvme in each host
[21:38] <LiftedKilt> m0zes__: what's the status on Bluestore?
[21:39] * sbfox (~Adium@vancouver.xmatters.com) has joined #ceph
[21:39] <LiftedKilt> is it even close to production ready?
[21:39] * sbfox (~Adium@vancouver.xmatters.com) Quit ()
[21:39] <m0zes__> tech preview in jewel, supposedly. I???m not ready to test it ;)
[21:39] <rkeene> LiftedKilt, I give each OSD an 8 GB partition on an SSD, limited to 13 (I think) partitions per SSD
[21:41] <rkeene> 13 came from operations, they said that if we detected and SSD that's how many OSDs could share it... With NVMe it may be higher and we may need to get more specific than SSD (which is actually fast+small)
[21:41] * spate (~Quackie@7V7AAFW6I.tor-irc.dnsbl.oftc.net) Quit ()
[21:41] <SamYaple> rkeene: bluestore
[21:42] <SamYaple> m0zes__: right bluestore! i have tested it. it.... ate my data
[21:42] <SamYaple> but the idea is solid
[21:42] <rkeene> Bluestore doesn't solve the problems I'm trying to solve with my filesystem
[21:43] <SamYaple> LiftedKilt: the goal is to have bluestore default backend by L release, but i suspect it wont be default until N
[21:43] <m0zes__> I was definitely not planning on testing it with irreplaceable data, but then again, leveldb is holding my data hostage now ;)
[21:43] <SamYaple> m0zes__: it was test data, so no harm no foul
[21:43] <LiftedKilt> rkeene: so you have ssd journals backing platter osds?
[21:44] * wjw-freebsd (~wjw@176.74.240.9) Quit (Ping timeout: 480 seconds)
[21:44] <rkeene> LiftedKilt, Yes
[21:44] <rkeene> LiftedKilt, Encrypted too ! :-D
[21:44] <rkeene> And multipathing
[21:44] <LiftedKilt> rkeene: nice
[21:44] <SamYaple> didnt you submit a patch for multipath a while back rkeene ?
[21:44] <SamYaple> or did you do a video on that
[21:44] <SamYaple> i seem to recall something about that
[21:45] * matj345314 (~matj34531@element.planetq.org) Quit (Quit: matj345314)
[21:45] <LiftedKilt> rkeene: we have 1k 1tb ssds, and I want to use them, I just don't want to eat all that performance loss if I don't have to
[21:45] <rkeene> SamYaple, No, nothing needed to be done for Ceph for multipathing -- that's all done before the filesystem is even mounted
[21:46] <SamYaple> i thought i recalled you having issues with it and ceph. im familiar with how multipathing works
[21:46] * adept256 (~Tonux@06SAADPO9.tor-irc.dnsbl.oftc.net) has joined #ceph
[21:46] <rkeene> No, I've been using it for years with Ceph without problems
[21:46] <SamYaple> LiftedKilt: as it is write now, you are looking at 3x writes per OSD. 1 for the osd journal, 1 for the filesystem journal, and finally one ofr the filesystem
[21:47] <SamYaple> LiftedKilt: with bluestore that should be 1 write (plus some metadata), but thats not the case right now
[21:47] <LiftedKilt> SamYaple: offloading journaling to an nvme ssd would reduce the writes to 2?
[21:48] <SamYaple> LiftedKilt: sure. ive got mine with intel 750s
[21:48] <SamYaple> but i use bcache with the osds (spinning disks)
[21:48] <LiftedKilt> SamYaple: my thought was 24x 1tb ssds per 1 256gb nvme ssd
[21:49] <SamYaple> it might be cheaper though to just but more ssds, just a thought. make sure to do the math correctly
[21:49] * allaok (~allaok@ARennes-658-1-135-88.w90-32.abo.wanadoo.fr) has joined #ceph
[21:49] <SamYaple> esh
[21:49] <SamYaple> well just remember when that 1 256gb nvme dies, it takes out 24 disks
[21:49] <LiftedKilt> SamYaple: true
[21:49] <LiftedKilt> so would you recommend just journaling on disk then?
[21:49] <SamYaple> if you already have ssds I absolutely would
[21:50] <m0zes__> personally, I???m using 400GB p3700 ssds for journaling. 1 for 8 osds???
[21:50] <SamYaple> m0zes__: thats far more reasonable
[21:51] * kefu|afk (~kefu@114.92.104.47) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[21:51] <LiftedKilt> m0zes__: 8 ssd osds or platters?
[21:51] <LiftedKilt> m0zes__: just curious
[21:52] <m0zes__> 8 platters. it leaves some performance left over for some lightly used ssd osds. (metadata for cephfs)
[21:52] <LiftedKilt> m0zes__: for sure
[21:56] * sbfox (~Adium@vancouver.xmatters.com) has joined #ceph
[21:58] * ninkotech (~duplo@static-84-242-87-186.net.upcbroadband.cz) Quit (Ping timeout: 480 seconds)
[21:58] * allaok (~allaok@ARennes-658-1-135-88.w90-32.abo.wanadoo.fr) Quit (Quit: Leaving.)
[22:00] * tserong (~tserong@203-214-92-220.dyn.iinet.net.au) Quit (Ping timeout: 480 seconds)
[22:00] * ntpttr_laptop (~ntpttr@192.55.54.42) Quit (Remote host closed the connection)
[22:00] <sbfox> I think you'll be hard pressed to saturate 24x1Tb drives on a single host, the network will become the bottleneck way before the IO system. I'd say journal on the ssd
[22:06] <SamYaple> sbfox: agreed
[22:06] * sbfox (~Adium@vancouver.xmatters.com) Quit (Read error: Connection reset by peer)
[22:06] * sbfox (~Adium@vancouver.xmatters.com) has joined #ceph
[22:06] <m0zes__> oh, I missed the fact those were 1TB ssds. yeah, journal on the same disk
[22:08] * ntpttr_laptop (~ntpttr@192.55.54.42) has joined #ceph
[22:10] * tserong (~tserong@203-214-92-220.dyn.iinet.net.au) has joined #ceph
[22:10] * DV (~veillard@2001:41d0:a:f29f::1) Quit (Remote host closed the connection)
[22:11] * DV (~veillard@2001:41d0:a:f29f::1) has joined #ceph
[22:15] * rendar (~I@host249-32-dynamic.37-79-r.retail.telecomitalia.it) Quit (Ping timeout: 480 seconds)
[22:15] * lmb (~Lars@tmo-102-171.customers.d1-online.com) Quit (Ping timeout: 480 seconds)
[22:15] * sbfox (~Adium@vancouver.xmatters.com) Quit (Quit: Leaving.)
[22:16] * adept256 (~Tonux@06SAADPO9.tor-irc.dnsbl.oftc.net) Quit ()
[22:16] * Quatroking1 (~w2k@exit1.ipredator.se) has joined #ceph
[22:17] * Rickus (~Rickus@office.protected.ca) Quit (Quit: Leaving)
[22:18] * Rickus (~Rickus@office.protected.ca) has joined #ceph
[22:21] <LiftedKilt> ok - thanks for the advice guys
[22:28] * dneary (~dneary@nat-pool-bos-u.redhat.com) has joined #ceph
[22:33] * ircolle (~Adium@2601:285:201:633a:7908:3cab:b6ac:d443) has joined #ceph
[22:36] * mykola (~Mikolaj@193.93.217.33) Quit (Quit: away)
[22:37] * dgurtner (~dgurtner@178.197.239.3) has joined #ceph
[22:40] * rendar (~I@host249-32-dynamic.37-79-r.retail.telecomitalia.it) has joined #ceph
[22:42] * vata (~vata@cable-192.222.249.207.electronicbox.net) Quit (Quit: Leaving.)
[22:45] * ngoswami (~ngoswami@1.39.14.201) Quit (Quit: Leaving)
[22:45] * ngoswami (~ngoswami@1.39.14.201) has joined #ceph
[22:45] * ngoswami (~ngoswami@1.39.14.201) Quit (Remote host closed the connection)
[22:46] * Quatroking1 (~w2k@06SAADPRA.tor-irc.dnsbl.oftc.net) Quit ()
[22:46] * Jamana (~geegeegee@193.189.117.180) has joined #ceph
[22:52] * Skaag (~lunix@65.200.54.234) has joined #ceph
[22:53] * joelc (~joelc@rrcs-71-41-248-34.sw.biz.rr.com) Quit (Remote host closed the connection)
[23:03] * rwheeler (~rwheeler@172.56.23.57) Quit (Quit: Leaving)
[23:06] * sbfox (~Adium@vancouver.xmatters.com) has joined #ceph
[23:08] * bniver (~bniver@2600:1000:b03d:e765:1914:14f1:6fa1:b7f4) Quit (Remote host closed the connection)
[23:16] * Jamana (~geegeegee@7V7AAFXA7.tor-irc.dnsbl.oftc.net) Quit ()
[23:16] * jwandborg (~tuhnis@tor2.asmer.com.ua) has joined #ceph
[23:17] * mattbenjamin1 (~mbenjamin@23.30.145.165) Quit (Ping timeout: 480 seconds)
[23:17] * mhack (~mhack@23.30.145.165) Quit (Ping timeout: 480 seconds)
[23:25] * jdillaman__ (~jdillaman@23.30.145.165) Quit (Quit: jdillaman__)
[23:26] * scg (~zscg@valis.gnu.org) Quit (Ping timeout: 480 seconds)
[23:26] * dnunez (~dnunez@nat-pool-bos-t.redhat.com) Quit (Quit: Leaving)
[23:28] * sbfox1 (~Adium@vancouver.xmatters.com) has joined #ceph
[23:32] * sbfox (~Adium@vancouver.xmatters.com) Quit (Ping timeout: 480 seconds)
[23:33] * rendar (~I@host249-32-dynamic.37-79-r.retail.telecomitalia.it) Quit (Quit: std::lower_bound + std::less_equal *works* with a vector without duplicates!)
[23:35] * gregmark (~Adium@68.87.42.115) Quit (Quit: Leaving.)
[23:39] * dcwangmit01 (~dcwangmit@162-245.23-239.PUBLIC.monkeybrains.net) Quit (Ping timeout: 480 seconds)
[23:43] * Lokta (~Lokta@carbon.coe.int) Quit (Ping timeout: 480 seconds)
[23:46] * jwandborg (~tuhnis@7V7AAFXCN.tor-irc.dnsbl.oftc.net) Quit ()
[23:46] * PeterRabbit (~xolotl@4MJAAF67R.tor-irc.dnsbl.oftc.net) has joined #ceph
[23:47] * m0zes__ (~mozes@n117m02.cis.ksu.edu) Quit (Ping timeout: 480 seconds)
[23:52] * linuxkidd (~linuxkidd@ip70-189-207-54.lv.lv.cox.net) Quit (Quit: Leaving)
[23:58] * ntpttr_laptop (~ntpttr@192.55.54.42) Quit (Remote host closed the connection)
[23:59] * ntpttr_laptop (~ntpttr@192.55.54.42) has joined #ceph
[23:59] * linuxkidd (~linuxkidd@166.170.49.87) has joined #ceph

These logs were automatically created by CephLogBot on irc.oftc.net using the Java IRC LogBot.