#ceph IRC Log

Index

IRC Log for 2015-06-07

Timestamps are in GMT/BST.

[0:02] * i_m (~ivan.miro@nat-5-carp.hcn-strela.ru) Quit (Ping timeout: 480 seconds)
[0:12] * dotblank (~AG_Clinto@tor.thd.ninja) has joined #ceph
[0:19] <jidar> hmm, anybody around can look at this error I'm running into when trying to do a `osd create` http://pastebin.com/aMVrgKmL
[0:33] <jidar> hmm
[0:33] <jidar> looks like one of the mount options is wrong
[0:33] <jidar> [ceph1][WARNIN] INFO:ceph-disk:Running command: /usr/bin/mount -t xfs -o -oinode64,noatime,logbsize=256k -- /dev/sdb1 /var/lib/ceph/tmp/mnt.n2i8GJ
[0:34] <jidar> after that -o, -oinode64 isn't right
[0:42] * dotblank (~AG_Clinto@3DDAAASX6.tor-irc.dnsbl.oftc.net) Quit ()
[0:51] * badone (~brad@CPE-121-215-241-179.static.qld.bigpond.net.au) has joined #ceph
[0:52] * danieagle (~Daniel@187.35.201.125) Quit (Quit: Obrigado por Tudo! :-) inte+ :-))
[0:54] * oblu (~o@62.109.134.112) Quit (Ping timeout: 480 seconds)
[1:05] * rotbeard (~redbeard@2a02:908:df10:d300:76f0:6dff:fe3b:994d) Quit (Ping timeout: 480 seconds)
[1:20] <jidar> oh man, if I have to open another ticket with redhat I'm going to jump off a bridge
[1:20] * janos_ (~messy@static-71-176-211-4.rcmdva.fios.verizon.net) Quit (Ping timeout: 480 seconds)
[1:29] <m0zes> why is inode64 not right?
[1:29] <m0zes> inode64 has been in xfs for a long time at this point.
[1:32] <flaf> Hi, What is the interest of inode64? I see often this option here but if I read the manpage I can read "This is provided for backwards compatibility...".
[1:34] * janos_ (~messy@static-71-176-211-4.rcmdva.fios.verizon.net) has joined #ceph
[1:34] <m0zes> in ealier kernels, if you didn't have inode64, all of the inode information was stored at the beginning (2TB?) of the disk. which could be painful for some recovery or reads.
[1:35] <flaf> m0zes: ok, so it's for old kernels. Do you know for which kernel versions?
[1:36] * JWilbur (~ghostnote@h-213.61.149.100.host.de.colt.net) has joined #ceph
[1:37] <flaf> For instance, with 3.X kernels, no need to inode64?
[1:41] <m0zes> 3.7+ no need for inode64.
[1:41] <m0zes> http://xfs.org/index.php/XFS_FAQ#Q:_Why_do_I_receive_No_space_left_on_device_after_xfs_growfs.3F
[1:42] <m0zes> not sure when it was added. 3.2?
[1:42] <flaf> m0zes: perfect. Thx for the information. ;)
[1:43] * badone (~brad@CPE-121-215-241-179.static.qld.bigpond.net.au) Quit (Ping timeout: 480 seconds)
[1:44] <flaf> Ah in fact, the point is that, since 3.7, inode64 is the default. Ok, I understand.
[1:45] * m0zes actually didn't know it had been made default until just a few minutes ago ;)
[1:45] * flaf too ;)
[1:46] * cholcombe (~chris@c-73-180-29-35.hsd1.or.comcast.net) has joined #ceph
[1:46] * cholcombe (~chris@c-73-180-29-35.hsd1.or.comcast.net) Quit ()
[1:55] * fmanana (~fdmanana@bl13-135-31.dsl.telepac.pt) Quit (Ping timeout: 480 seconds)
[2:02] * badone (~brad@CPE-121-215-241-179.static.qld.bigpond.net.au) has joined #ceph
[2:06] <jidar> mongo: flaf, this is coming from the ceph-deploy out of a RHEL based system
[2:06] * JWilbur (~ghostnote@5NZAADDRW.tor-irc.dnsbl.oftc.net) Quit ()
[2:06] * SEBI1 (~rushworld@9S0AAARZJ.tor-irc.dnsbl.oftc.net) has joined #ceph
[2:06] <jidar> and the option -oinode64 isn't syntax correct,
[2:08] <flaf> jidar: are you sure?
[2:08] <flaf> In `man mount`, no inode64 option?
[2:08] <flaf> Oh jidar...
[2:09] <flaf> This is not correct => -o -oinode64,noatime,logbsize=256k
[2:09] <jidar> yes
[2:09] <flaf> This is better => -o inode64,noatime,logbsize=256k
[2:09] <jidar> correct!
[2:09] <jidar> see pastie: http://pastebin.com/q36ZKTYH
[2:10] <flaf> Yes, in your paste I can see "-o -inode64,..."
[2:10] <jidar> no second dash, but other than that correct
[2:10] <jidar> anyway, so the tool is screwed up on rhel or what?
[2:11] <flaf> I don't know but in your paste the command is not correct.
[2:11] <jidar> [root@rcdn6-rhos6ce1 cluster]# ceph-deploy --overwrite-conf osd create ceph1:/dev/sdc:/dev/sdk ^C
[2:11] <jidar> that's what I'm running from my ceph-admin node
[2:11] <flaf> And in your ceph.conf?
[2:12] <jidar> osd_mount_options_xfs = -o inode64,noatime,logbsize=256k
[2:12] <flaf> Not good I think.
[2:12] <flaf> Try => osd_mount_options_xfs = inode64,noatime,logbsize=256k
[2:12] <jidar> yea
[2:13] <flaf> This is why you had a "-o" parasite.
[2:14] <jidar> ah fantastic, that does seem to work
[2:14] <flaf> (so the inode64 exists. ;))
[2:14] * KevinPerks (~Adium@cpe-75-177-32-14.triad.res.rr.com) has joined #ceph
[2:14] <jidar> that's so weird because I just did a 'ceph-deploy config pull ceph1' to start with
[2:14] <jidar> thinking the config would be right from the defaults..
[2:14] * jidar boggles
[2:15] <jidar> anyway, moving right along!
[2:20] * badone (~brad@CPE-121-215-241-179.static.qld.bigpond.net.au) Quit (Ping timeout: 480 seconds)
[2:27] * stiopa (~stiopa@cpc73828-dals21-2-0-cust630.20-2.cable.virginm.net) Quit (Ping timeout: 480 seconds)
[2:31] <rkeene> ~~~~~~~ bn vzx
[2:31] <rkeene> 'xz'xc
[2:31] <rkeene>
[2:35] * TMM (~hp@178-84-46-106.dynamic.upc.nl) Quit (Ping timeout: 480 seconds)
[2:36] * SEBI1 (~rushworld@9S0AAARZJ.tor-irc.dnsbl.oftc.net) Quit ()
[2:36] * delcake (~rapedex@marylou.nos-oignons.net) has joined #ceph
[2:38] * wschulze (~wschulze@cpe-69-206-240-164.nyc.res.rr.com) has joined #ceph
[2:39] * TMM (~hp@178-84-46-106.dynamic.upc.nl) has joined #ceph
[2:42] * wschulze1 (~wschulze@cpe-69-206-240-164.nyc.res.rr.com) has joined #ceph
[2:42] * wschulze (~wschulze@cpe-69-206-240-164.nyc.res.rr.com) Quit (Read error: Connection reset by peer)
[2:58] * DV (~veillard@2001:41d0:1:d478::1) has joined #ceph
[3:05] * DV_ (~veillard@2001:41d0:a:f29f::1) Quit (Ping timeout: 480 seconds)
[3:05] * oblu (~o@62.109.134.112) has joined #ceph
[3:06] * delcake (~rapedex@8Q4AABB2E.tor-irc.dnsbl.oftc.net) Quit ()
[3:06] * darks (~mrapple@178-175-128-50.ip.as43289.net) has joined #ceph
[3:07] * dneary (~dneary@pool-96-252-45-212.bstnma.fios.verizon.net) has joined #ceph
[3:19] * wschulze1 (~wschulze@cpe-69-206-240-164.nyc.res.rr.com) Quit (Ping timeout: 480 seconds)
[3:28] <aarontc> has anyone recovered from an incomplete PG on 0.94.1.2?
[3:31] * georgem (~Adium@104-222-113-61.cpe.teksavvy.com) has joined #ceph
[3:31] * georgem (~Adium@104-222-113-61.cpe.teksavvy.com) has left #ceph
[3:31] * doppelgrau (~doppelgra@pd956d116.dip0.t-ipconnect.de) Quit (Quit: doppelgrau)
[3:36] * darks (~mrapple@5NZAADDUT.tor-irc.dnsbl.oftc.net) Quit ()
[3:36] * Zombiekiller (~rhonabwy@exit1.telostor.ca) has joined #ceph
[3:41] * xcezzz (~xcezzz@107.144.53.7) has joined #ceph
[3:49] * oblu (~o@62.109.134.112) Quit (Quit: ~)
[3:53] * oblu (~o@62.109.134.112) has joined #ceph
[3:56] * kefu (~kefu@60.247.111.66) has joined #ceph
[3:57] * derjohn_mobi (~aj@x590c2f1d.dyn.telefonica.de) has joined #ceph
[4:04] * derjohn_mob (~aj@x590dbfc1.dyn.telefonica.de) Quit (Ping timeout: 480 seconds)
[4:06] * Zombiekiller (~rhonabwy@9S0AAAR3W.tor-irc.dnsbl.oftc.net) Quit ()
[4:06] * Diablothein (~chrisinaj@8Q4AABB3X.tor-irc.dnsbl.oftc.net) has joined #ceph
[4:17] * oblu (~o@62.109.134.112) Quit (Quit: ~)
[4:19] * kefu (~kefu@60.247.111.66) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[4:19] * Steki (~steki@cable-89-216-230-194.dynamic.sbb.rs) has joined #ceph
[4:22] * kefu (~kefu@60.247.111.66) has joined #ceph
[4:25] * BManojlovic (~steki@87.116.172.137) Quit (Ping timeout: 480 seconds)
[4:35] * TMM (~hp@178-84-46-106.dynamic.upc.nl) Quit (Ping timeout: 480 seconds)
[4:36] * Diablothein (~chrisinaj@8Q4AABB3X.tor-irc.dnsbl.oftc.net) Quit ()
[4:36] * Nijikokun (~ChauffeR@185.77.129.11) has joined #ceph
[4:36] * TMM (~hp@178-84-46-106.dynamic.upc.nl) has joined #ceph
[4:40] * yguang11 (~yguang11@12.31.82.125) has joined #ceph
[5:06] * Nijikokun (~ChauffeR@9S0AAAR6N.tor-irc.dnsbl.oftc.net) Quit ()
[5:06] * AotC (apx@r2.geoca.st) has joined #ceph
[5:09] * oblu (~o@62.109.134.112) has joined #ceph
[5:15] * kefu (~kefu@60.247.111.66) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[5:15] * dneary (~dneary@pool-96-252-45-212.bstnma.fios.verizon.net) Quit (Ping timeout: 480 seconds)
[5:23] * Vacuum_ (~Vacuum@i59F79B5A.versanet.de) has joined #ceph
[5:29] * xcezzz (~xcezzz@107.144.53.7) Quit (Quit: Leaving)
[5:30] * Vacuum (~Vacuum@i59F79DAD.versanet.de) Quit (Ping timeout: 480 seconds)
[5:33] * haomaiwang (~haomaiwan@114.111.166.250) Quit (Remote host closed the connection)
[5:34] * haomaiwang (~haomaiwan@118.244.254.4) has joined #ceph
[5:35] * badone (~brad@CPE-121-215-241-179.static.qld.bigpond.net.au) has joined #ceph
[5:36] * AotC (apx@5NZAADDZD.tor-irc.dnsbl.oftc.net) Quit ()
[5:36] * toast (~Pieman@marylou.nos-oignons.net) has joined #ceph
[5:42] * haomaiwang (~haomaiwan@118.244.254.4) Quit (Ping timeout: 480 seconds)
[5:55] * badone (~brad@CPE-121-215-241-179.static.qld.bigpond.net.au) Quit (Ping timeout: 480 seconds)
[6:06] * toast (~Pieman@9S0AAAR9I.tor-irc.dnsbl.oftc.net) Quit ()
[6:06] * MonkeyJamboree (~geegeegee@marylou.nos-oignons.net) has joined #ceph
[6:23] * yguang11_ (~yguang11@2001:4998:effd:7801::101c) has joined #ceph
[6:25] * haomaiwang (~haomaiwan@114.111.166.250) has joined #ceph
[6:29] * yguang11 (~yguang11@12.31.82.125) Quit (Ping timeout: 480 seconds)
[6:36] * MonkeyJamboree (~geegeegee@5NZAADD1K.tor-irc.dnsbl.oftc.net) Quit ()
[6:36] * Wijk (~mason@cloud.tor.ninja) has joined #ceph
[6:39] * vbellur (~vijay@122.172.46.139) has joined #ceph
[6:44] * KevinPerks (~Adium@cpe-75-177-32-14.triad.res.rr.com) Quit (Quit: Leaving.)
[6:46] * midnightrunner (~midnightr@c-67-174-241-112.hsd1.ca.comcast.net) has joined #ceph
[7:06] * Wijk (~mason@9S0AAASB3.tor-irc.dnsbl.oftc.net) Quit ()
[7:06] * Misacorp (~straterra@hessel0.torservers.net) has joined #ceph
[7:36] * Misacorp (~straterra@5NZAADD38.tor-irc.dnsbl.oftc.net) Quit ()
[7:36] * ghostnote (~Freddy@h-213.61.149.100.host.de.colt.net) has joined #ceph
[8:06] * ghostnote (~Freddy@5NZAADD5K.tor-irc.dnsbl.oftc.net) Quit ()
[8:06] * ylmson (~Gecko1986@ns365892.ip-94-23-6.eu) has joined #ceph
[8:25] * badone (~brad@CPE-121-215-241-179.static.qld.bigpond.net.au) has joined #ceph
[8:32] * rotbeard (~redbeard@2a02:908:df10:d300:76f0:6dff:fe3b:994d) has joined #ceph
[8:33] * mykola (~Mikolaj@91.225.200.209) has joined #ceph
[8:35] * TMM (~hp@178-84-46-106.dynamic.upc.nl) Quit (Ping timeout: 480 seconds)
[8:36] * ylmson (~Gecko1986@8Q4AABB7N.tor-irc.dnsbl.oftc.net) Quit ()
[8:36] * SurfMaths (~Linkshot@exit1.torproxy.org) has joined #ceph
[8:39] * TMM (~hp@178-84-46-106.dynamic.upc.nl) has joined #ceph
[8:51] * doppelgrau (~doppelgra@pd956d116.dip0.t-ipconnect.de) has joined #ceph
[9:00] * markl_ (~mark@knm.org) has joined #ceph
[9:00] * markl (~mark@knm.org) Quit (Read error: Connection reset by peer)
[9:06] * SurfMaths (~Linkshot@8Q4AABB73.tor-irc.dnsbl.oftc.net) Quit ()
[9:06] * FNugget (~Arcturus@176.10.99.203) has joined #ceph
[9:13] * yguang11_ (~yguang11@2001:4998:effd:7801::101c) Quit (Ping timeout: 480 seconds)
[9:13] * markl_ (~mark@knm.org) Quit (Read error: Connection reset by peer)
[9:13] * jashank42 (~jashan42@59.89.78.215) has joined #ceph
[9:13] * markl (~mark@knm.org) has joined #ceph
[9:14] * jclm (~jclm@122.181.21.134) Quit (Ping timeout: 480 seconds)
[9:15] * yanzheng (~zhyan@171.216.94.129) has joined #ceph
[9:17] * wicope (~wicope@0001fd8a.user.oftc.net) has joined #ceph
[9:24] * oro (~oro@84-72-20-79.dclient.hispeed.ch) has joined #ceph
[9:36] * FNugget (~Arcturus@8Q4AABB8Q.tor-irc.dnsbl.oftc.net) Quit ()
[9:36] * Thayli (~Inuyasha@politkovskaja.torservers.net) has joined #ceph
[9:37] * stiopa (~stiopa@cpc73828-dals21-2-0-cust630.20-2.cable.virginm.net) has joined #ceph
[9:38] * markl_ (~mark@knm.org) has joined #ceph
[9:38] * markl (~mark@knm.org) Quit (Read error: Connection reset by peer)
[9:40] * karnan (~karnan@106.51.132.97) has joined #ceph
[9:42] * jclm (~jclm@122.181.21.134) has joined #ceph
[9:44] * markl_ (~mark@knm.org) Quit (Read error: Connection reset by peer)
[9:45] * markl (~mark@knm.org) has joined #ceph
[9:45] * calvinx (~calvin@101.100.172.246) has joined #ceph
[9:48] * jclm1 (~jclm@122.181.21.134) has joined #ceph
[9:49] * oro (~oro@84-72-20-79.dclient.hispeed.ch) Quit (Ping timeout: 480 seconds)
[9:50] * jclm (~jclm@122.181.21.134) Quit (Ping timeout: 480 seconds)
[9:51] * markl (~mark@knm.org) Quit (Read error: Connection reset by peer)
[9:59] * nardial (~ls@dslb-178-009-182-130.178.009.pools.vodafone-ip.de) has joined #ceph
[9:59] * i_m (~ivan.miro@nat-5-carp.hcn-strela.ru) has joined #ceph
[10:02] <cetex> 
[10:06] * Thayli (~Inuyasha@5NZAADEAE.tor-irc.dnsbl.oftc.net) Quit ()
[10:06] * AG_Clinton (~lobstar@sh3llbox.hu) has joined #ceph
[10:06] * kefu (~kefu@114.241.9.154) has joined #ceph
[10:08] * jashank42 (~jashan42@59.89.78.215) Quit (Ping timeout: 480 seconds)
[10:08] * linjan (~linjan@195.110.41.9) has joined #ceph
[10:20] * kefu (~kefu@114.241.9.154) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[10:22] * oro (~oro@84-72-20-79.dclient.hispeed.ch) has joined #ceph
[10:26] * jashank42 (~jashan42@117.215.149.201) has joined #ceph
[10:29] * calvinx (~calvin@101.100.172.246) Quit (Quit: calvinx)
[10:30] * ChrisNBlum (~ChrisNBlu@dhcp-ip-190.dorf.rwth-aachen.de) has joined #ceph
[10:31] * ghartz_ (~ghartz@AStrasbourg-651-1-162-51.w90-6.abo.wanadoo.fr) has joined #ceph
[10:32] * calvinx (~calvin@101.100.172.246) has joined #ceph
[10:34] * TMM (~hp@178-84-46-106.dynamic.upc.nl) Quit (Ping timeout: 480 seconds)
[10:35] * TMM (~hp@178-84-46-106.dynamic.upc.nl) has joined #ceph
[10:36] * AG_Clinton (~lobstar@7R2AABJCK.tor-irc.dnsbl.oftc.net) Quit ()
[10:36] * kalleeen (~Throlkim@0.tor.exit.babylon.network) has joined #ceph
[10:38] * JFQ (~ghartz@AStrasbourg-651-1-162-51.w90-6.abo.wanadoo.fr) Quit (Ping timeout: 480 seconds)
[10:39] * karnan (~karnan@106.51.132.97) Quit (Ping timeout: 480 seconds)
[10:49] * karnan (~karnan@106.51.242.30) has joined #ceph
[10:54] * kefu (~kefu@114.241.9.154) has joined #ceph
[10:55] * nardial (~ls@dslb-178-009-182-130.178.009.pools.vodafone-ip.de) Quit (Quit: Leaving)
[11:06] * kalleeen (~Throlkim@9S0AAASMX.tor-irc.dnsbl.oftc.net) Quit ()
[11:06] * PappI (~Freddy@spftor1e1.privacyfoundation.ch) has joined #ceph
[11:14] * marvin999 (~marvin999@ppp-6-246.29-151.libero.it) has joined #ceph
[11:18] * stiopa (~stiopa@cpc73828-dals21-2-0-cust630.20-2.cable.virginm.net) Quit (Quit: Lost terminal)
[11:22] * karnan (~karnan@106.51.242.30) Quit (Ping timeout: 480 seconds)
[11:27] * marvin999 (~marvin999@ppp-6-246.29-151.libero.it) Quit (Quit: Leaving)
[11:28] * marvin999 (~marvin999@ppp-6-246.29-151.libero.it) has joined #ceph
[11:28] * marvin999 (~marvin999@ppp-6-246.29-151.libero.it) Quit ()
[11:30] * badone (~brad@CPE-121-215-241-179.static.qld.bigpond.net.au) Quit (Ping timeout: 480 seconds)
[11:32] * wicope (~wicope@0001fd8a.user.oftc.net) Quit (Remote host closed the connection)
[11:36] * jashank42 (~jashan42@117.215.149.201) Quit (Ping timeout: 480 seconds)
[11:36] * PappI (~Freddy@7R2AABJDL.tor-irc.dnsbl.oftc.net) Quit ()
[11:36] * Blueraven (~Popz@marcuse-2.nos-oignons.net) has joined #ceph
[11:44] * jashank42 (~jashan42@117.197.175.26) has joined #ceph
[11:54] * jashank42 (~jashan42@117.197.175.26) Quit (Ping timeout: 480 seconds)
[11:58] * karnan (~karnan@106.51.135.131) has joined #ceph
[12:06] * Blueraven (~Popz@9S0AAASPI.tor-irc.dnsbl.oftc.net) Quit ()
[12:06] * _s1gma (~Zombiekil@185.77.129.88) has joined #ceph
[12:07] * fridim_ (~fridim@56-198-190-109.dsl.ovh.fr) has joined #ceph
[12:20] * kefu (~kefu@114.241.9.154) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[12:24] * kefu (~kefu@114.241.9.154) has joined #ceph
[12:35] * TMM (~hp@178-84-46-106.dynamic.upc.nl) Quit (Ping timeout: 480 seconds)
[12:36] * _s1gma (~Zombiekil@5NZAADEE5.tor-irc.dnsbl.oftc.net) Quit ()
[12:36] * TMM (~hp@178-84-46-106.dynamic.upc.nl) has joined #ceph
[12:36] * DougalJacobs (~DoDzy@spftor5e2.privacyfoundation.ch) has joined #ceph
[12:37] * oro (~oro@84-72-20-79.dclient.hispeed.ch) Quit (Ping timeout: 480 seconds)
[12:39] * kefu (~kefu@114.241.9.154) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[12:47] * doppelgrau (~doppelgra@pd956d116.dip0.t-ipconnect.de) Quit (Quit: doppelgrau)
[12:52] * kefu (~kefu@114.241.9.154) has joined #ceph
[13:06] * DougalJacobs (~DoDzy@8Q4AABCDQ.tor-irc.dnsbl.oftc.net) Quit ()
[13:07] * karnan (~karnan@106.51.135.131) Quit (Ping timeout: 480 seconds)
[13:11] * Sysadmin88 (~IceChat77@054527d3.skybroadband.com) Quit (Quit: If you can't laugh at yourself, make fun of other people.)
[13:12] * shnarch (~shnarch@2.52.0.245) has joined #ceph
[13:19] * karnan (~karnan@106.51.132.135) has joined #ceph
[13:20] * mykola (~Mikolaj@91.225.200.209) Quit (Remote host closed the connection)
[13:21] * shnarch (~shnarch@2.52.0.245) Quit (Ping timeout: 480 seconds)
[13:25] * kefu (~kefu@114.241.9.154) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[13:26] * Steki (~steki@cable-89-216-230-194.dynamic.sbb.rs) Quit (Quit: Ja odoh a vi sta 'ocete...)
[13:38] * jschmid (~jxs@nl13x.mullvad.net) has joined #ceph
[13:40] * oro (~oro@84-72-20-79.dclient.hispeed.ch) has joined #ceph
[13:41] * karnan (~karnan@106.51.132.135) Quit (Ping timeout: 480 seconds)
[13:42] * fmanana (~fdmanana@bl13-135-31.dsl.telepac.pt) has joined #ceph
[13:45] * KevinPerks (~Adium@cpe-75-177-32-14.triad.res.rr.com) has joined #ceph
[13:46] * jschmid (~jxs@nl13x.mullvad.net) Quit (Ping timeout: 480 seconds)
[13:58] * karnan (~karnan@106.51.133.255) has joined #ceph
[14:03] * jashank42 (~jashan42@59.89.79.72) has joined #ceph
[14:06] * ItsCriminalAFK (~Zeis@37.46.122.195) has joined #ceph
[14:36] * TMM (~hp@178-84-46-106.dynamic.upc.nl) Quit (Ping timeout: 480 seconds)
[14:36] * ItsCriminalAFK (~Zeis@5NZAADEIX.tor-irc.dnsbl.oftc.net) Quit ()
[14:36] * luigiman (~Borf@spftor1e1.privacyfoundation.ch) has joined #ceph
[14:37] * TMM (~hp@178-84-46-106.dynamic.upc.nl) has joined #ceph
[14:42] * jdillaman (~jdillaman@pool-108-18-97-82.washdc.fios.verizon.net) has joined #ceph
[14:52] * dgurtner (~dgurtner@217-162-119-191.dynamic.hispeed.ch) has joined #ceph
[14:55] * rotbeard (~redbeard@2a02:908:df10:d300:76f0:6dff:fe3b:994d) Quit (Read error: Permission denied)
[14:55] * rotbeard (~redbeard@2a02:908:df10:d300:76f0:6dff:fe3b:994d) has joined #ceph
[15:04] * MACscr1 (~Adium@2601:d:c800:de3:84d0:16ca:4290:5c73) Quit (Ping timeout: 480 seconds)
[15:06] * luigiman (~Borf@9S0AAASVD.tor-irc.dnsbl.oftc.net) Quit ()
[15:06] * Wijk (~hassifa@ncc-1701-a.tor-exit.network) has joined #ceph
[15:08] * rotbeard (~redbeard@2a02:908:df10:d300:76f0:6dff:fe3b:994d) Quit (Quit: Verlassend)
[15:13] * shnarch (~shnarch@2.52.0.245) has joined #ceph
[15:28] <shnarch> Hi,
[15:28] <shnarch> I???m trying to install ceph in a secured environment without access to the internet.
[15:28] <shnarch> When I???m trying to run ceph-deploy install on the nodes i get this error:
[15:28] <shnarch> RuntimeError: Failed to execute command: rpm --import https://ceph.com/git/?p=ceph.git;a=blob_plaint;f=keys/release.asc
[15:28] <shnarch> What should i do?
[15:29] * jashank42 (~jashan42@59.89.79.72) Quit (Ping timeout: 480 seconds)
[15:30] * doppelgrau (~doppelgra@pd956d116.dip0.t-ipconnect.de) has joined #ceph
[15:36] * Wijk (~hassifa@7R2AABJH4.tor-irc.dnsbl.oftc.net) Quit ()
[15:42] * shnarch (~shnarch@2.52.0.245) Quit (Ping timeout: 480 seconds)
[15:45] * alphe (~void@0001ac6f.user.oftc.net) has joined #ceph
[15:45] <alphe> hello everyone
[15:46] <alphe> I have a problem 1500 pg are active+replay if I restart the osd then I get the whole pg repeering which slows unecesarily my pgs
[15:47] <alphe> my osd then I never all the pg active+clean
[15:47] <alphe> is there a way other than restart all osd to bring to active+clean all the pg in active+replay state
[15:48] <alphe> basically I know the problem originates from an error I set pg num to 8256
[15:48] <alphe> for only 20 osd ...
[15:49] <alphe> too much pg make to much moves that saturate my ceph osd
[15:52] <bilco105_> alphe: Have you set no-out on your ceph cluster? - you can then restart OSDs and them disconnecting won't cause a rebalance
[15:55] <alphe> i have set nodown
[15:55] <bilco105_> noout is the one you want
[15:56] <bilco105_> rebalancing happens when an OSD is marked as out, not as down
[15:56] <alphe> but as the osd of my cluster are laggy because of too many pgs if one osd is detected as missing then the whole cluster goes avok rebuilding and i get an cascade of osd lags
[15:56] <bilco105_> which if I remember correctly, happens 5 minutes after being marked down
[15:56] <alphe> i get soon 3 osd up to 20 osd ...
[15:58] <alphe> ok soo to solve the too much pgs problem which is the core reason my osds gets laggy and my cluster is stuck in forever rebuilding
[15:58] <alphe> the only way is to destroy the cluster and rebuild it ?
[15:59] <bilco105_> Having such a high PG number shouldn't cause that many problems
[16:00] <bilco105_> You should be able to recover the cluster, then create new pools with a lower PG and migrate data
[16:00] <alphe> well if you use a xeon processor on your nodes that host your osd
[16:00] <bilco105_> Try setting the min_size on each pool to #1, which will stop it from creating multiple copies
[16:00] <alphe> and if you have like 10GB or ram on each nodes for 4TB on 2 osd of 2TB
[16:01] <alphe> I have atom procs and 4gb on each of my nodes and that is limit limit
[16:03] <alphe> but you are right before 0.94.1 when I had so much pg there wasn t problems
[16:04] <alphe> now in 0.94.1 it seems like the rebuilding process is more agressive
[16:04] <alphe> so it use more ram more cpu and my little machines lags like hell
[16:05] <alphe> 53 requests are blocked > 32 sec
[16:06] * flisky (~Thunderbi@59.109.104.166) has joined #ceph
[16:06] * Mattress (~Pulec@185.77.129.11) has joined #ceph
[16:16] <alphe> its like before ceph hammer version the osd down / out detection was more relaxed like if I have osd that not answer in 10 minutes then i considere them down
[16:17] <alphe> now its if I have an osd that don t answer in 10 seconds then I start rebuilding process
[16:18] * karnan (~karnan@106.51.133.255) Quit (Ping timeout: 480 seconds)
[16:26] <bilco105_> alphe: you could also reduce the amount of recovery processes
[16:26] * karnan (~karnan@223.229.166.222) has joined #ceph
[16:26] <bilco105_> My reccommendation would be to disable all forms of recovery whilst you try and get all your OSDs all back Up and In
[16:26] <bilco105_> Then re-enable them in a staged manner
[16:29] * yanzheng (~zhyan@171.216.94.129) Quit (Quit: This computer has gone to sleep)
[16:29] <alphe> yeah
[16:31] <bilco105_> alphe: for i in noup noin noscrub nodeep-scrub norecover nobackfill; do ceph osd set $i; done
[16:31] <alphe> already done
[16:31] <alphe> but i let the rebalance and the recover
[16:34] * dgurtner (~dgurtner@217-162-119-191.dynamic.hispeed.ch) Quit (Ping timeout: 480 seconds)
[16:36] * Mattress (~Pulec@8Q4AABCIH.tor-irc.dnsbl.oftc.net) Quit ()
[16:36] * Jones (~loft@7R2AABJJ8.tor-irc.dnsbl.oftc.net) has joined #ceph
[16:37] * TMM (~hp@178-84-46-106.dynamic.upc.nl) Quit (Ping timeout: 480 seconds)
[16:37] * dgurtner (~dgurtner@217-162-119-191.dynamic.hispeed.ch) has joined #ceph
[16:38] * TMM (~hp@178-84-46-106.dynamic.upc.nl) has joined #ceph
[16:42] * calvinx (~calvin@101.100.172.246) Quit (Quit: calvinx)
[16:43] * stj (~stj@2604:a880:800:10::2cc:b001) Quit (Quit: rebut)
[16:48] * flisky (~Thunderbi@59.109.104.166) Quit (Quit: flisky)
[16:52] <alphe> now my ceph cluster is like doing nothing
[16:53] * stj (~stj@2604:a880:800:10::2cc:b001) has joined #ceph
[16:56] <alphe> the weird thing is in previous version of ceph when I did a full ceph cluster stop and then a full cluster start even if I had errors then it cleared its state and started as new now its like that it doesn t work
[16:56] <alphe> once all fully started I get exactly what I had before
[16:56] <alphe> in terms of pg states
[16:59] <bilco105_> alphe: What is ceph health detail showing?
[16:59] <alphe> tons of crap ...
[17:00] <alphe> I have a ton of pg in repeering and 4 stuck requests
[17:00] <alphe> so 1 osd is very laggy
[17:00] <alphe> tryed to just restart that and not working
[17:00] <bilco105_> well, it's not doing nothing then if it's repeering
[17:01] <bilco105_> Check out the stuck requests, they may be failing because there's only 1 copy of the data available, so you'd need to set min_size 1 on the pool
[17:02] <bilco105_> continually restarting osds that are up and in won't be helping though
[17:06] * Jones (~loft@7R2AABJJ8.tor-irc.dnsbl.oftc.net) Quit ()
[17:06] * nastidon (~Frostshif@5NZAADEQA.tor-irc.dnsbl.oftc.net) has joined #ceph
[17:07] <alphe> if I restart the osd that as stuck request it works
[17:08] <alphe> the stuck request desapear
[17:08] * haomaiwang (~haomaiwan@114.111.166.250) Quit (Remote host closed the connection)
[17:10] <alphe> set pool 1 min_size to 1
[17:10] <alphe> set pool 2 min_size to 1
[17:11] <alphe> so my pools metadata and cephfs_data are set to min_size 1
[17:12] <alphe> ssems that is the reason why they are stuck ondisk+write+known_if_redirected
[17:13] <bilco105_> so are things progressing now?
[17:13] <alphe> nope
[17:13] <bilco105_> you've just changed the pools to min_size 1? or was it already set to that?
[17:13] <alphe> but i have no scrub and no deepscrub set
[17:13] <alphe> i just did it
[17:14] <bilco105_> so what is ceph health showing now? any blocked requests?
[17:14] * rotbeard (~redbeard@2a02:908:df10:d300:76f0:6dff:fe3b:994d) has joined #ceph
[17:15] <alphe> http://pastebin.com/QzcLRrGj
[17:15] <alphe> bilco105_, the pastebin with the current state of my cluster
[17:15] * karnan (~karnan@223.229.166.222) Quit (Read error: Connection reset by peer)
[17:16] * yguang11 (~yguang11@12.31.82.125) has joined #ceph
[17:25] <alphe> hum seems that alternating set / unset of noscrub slowly solve the problem I have less and less pg in activate +replay
[17:25] <alphe> from 1500 to 800 now
[17:31] * fridim_ (~fridim@56-198-190-109.dsl.ovh.fr) Quit (Ping timeout: 480 seconds)
[17:33] <alphe> seems i get it right now so first i set noscrub then I stop wait some seconds start one of the osd with stuck request
[17:34] <alphe> then I wait some more second and unset noscrub and magically the active+replay pg on that osd are nicely scubed the number of active+clean raise and the number of active+clean+reply lower
[17:36] * karnan (~karnan@106.51.132.100) has joined #ceph
[17:36] * nastidon (~Frostshif@5NZAADEQA.tor-irc.dnsbl.oftc.net) Quit ()
[17:41] * haomaiwang (~haomaiwan@118.244.254.29) has joined #ceph
[17:48] <alphe> active+clean+replay 498 pgs
[17:49] <alphe> 434
[17:50] <alphe> 414
[17:50] <alphe> its like I m scubing manually pg per pg ...
[17:51] * calvinx (~calvin@101.100.172.246) has joined #ceph
[17:53] * calvinx (~calvin@101.100.172.246) Quit ()
[17:54] <alphe> oh! I noticed too that most of the documentation on ceph wiki has been updated thank you for this titanic effort
[17:54] <alphe> their is more details on every aspect of ceph and that is great
[17:54] <alphe> 331 active+clean + replay
[17:55] <alphe> 331 active+clean + replay
[17:58] * karnan (~karnan@106.51.132.100) Quit (Ping timeout: 480 seconds)
[18:02] * jashank42 (~jashan42@61.0.108.143) has joined #ceph
[18:05] * derjohn_mobi (~aj@x590c2f1d.dyn.telefonica.de) Quit (Ping timeout: 480 seconds)
[18:07] * karnan (~karnan@106.51.132.128) has joined #ceph
[18:08] <alphe> 127
[18:11] * delcake (~Atomizer@176.10.99.200) has joined #ceph
[18:12] * evilrob00 (~evilrob00@cpe-72-179-3-209.austin.res.rr.com) has joined #ceph
[18:20] * wicope (~wicope@0001fd8a.user.oftc.net) has joined #ceph
[18:20] * jashank42 (~jashan42@61.0.108.143) Quit (Remote host closed the connection)
[18:28] * vpol (~vpol@000131a0.user.oftc.net) has joined #ceph
[18:32] * karnan (~karnan@106.51.132.128) Quit (Ping timeout: 480 seconds)
[18:34] * TMM (~hp@178-84-46-106.dynamic.upc.nl) Quit (Ping timeout: 480 seconds)
[18:37] * ChrisNBl_ (~ChrisNBlu@dhcp-ip-190.dorf.rwth-aachen.de) has joined #ceph
[18:39] * TMM (~hp@178-84-46-106.dynamic.upc.nl) has joined #ceph
[18:41] * delcake (~Atomizer@8Q4AABCLF.tor-irc.dnsbl.oftc.net) Quit ()
[18:41] * Throlkim (~w2k@9S0AAAS3O.tor-irc.dnsbl.oftc.net) has joined #ceph
[18:44] * ChrisNBlum (~ChrisNBlu@dhcp-ip-190.dorf.rwth-aachen.de) Quit (Ping timeout: 480 seconds)
[18:44] * karnan (~karnan@223.239.244.139) has joined #ceph
[18:46] <alphe> iam with 23 pg active+clean+replay
[18:55] * shnarch (~shnarch@2.52.139.92) has joined #ceph
[18:56] * jashank42 (~jashan42@61.0.108.143) has joined #ceph
[19:07] * vpol (~vpol@000131a0.user.oftc.net) Quit (Quit: vpol)
[19:09] * sep (~sep@2a04:2740:1:0:52e5:49ff:feeb:32) Quit (Ping timeout: 480 seconds)
[19:11] * Throlkim (~w2k@9S0AAAS3O.tor-irc.dnsbl.oftc.net) Quit ()
[19:11] * ChauffeR1 (~neobenedi@aurora.enn.lu) has joined #ceph
[19:12] <alphe> done all osd are back active+clean cool and dandy
[19:15] * oro (~oro@84-72-20-79.dclient.hispeed.ch) Quit (Ping timeout: 480 seconds)
[19:18] * sep (~sep@95.62-50-191.enivest.net) has joined #ceph
[19:28] * mykola (~Mikolaj@91.225.200.209) has joined #ceph
[19:41] * ChauffeR1 (~neobenedi@8Q4AABCMV.tor-irc.dnsbl.oftc.net) Quit ()
[19:41] * ZombieL (~aleksag@0.tor.exit.babylon.network) has joined #ceph
[19:46] * vpol (~vpol@000131a0.user.oftc.net) has joined #ceph
[19:49] * yguang11_ (~yguang11@2001:4998:effd:7801::10fa) has joined #ceph
[19:51] * oro (~oro@84-72-20-79.dclient.hispeed.ch) has joined #ceph
[19:55] * yguang11 (~yguang11@12.31.82.125) Quit (Ping timeout: 480 seconds)
[19:56] * oro (~oro@84-72-20-79.dclient.hispeed.ch) Quit ()
[20:11] * ZombieL (~aleksag@0SGAAA82A.tor-irc.dnsbl.oftc.net) Quit ()
[20:11] * murmur1 (~Kurimus@exit-01c.noisetor.net) has joined #ceph
[20:13] * mlausch (~mlausch@2001:8d8:1fe:7:6c02:4099:6d2f:288e) Quit (Ping timeout: 480 seconds)
[20:15] * alphe (~void@0001ac6f.user.oftc.net) Quit (Quit: Leaving)
[20:18] * linjan (~linjan@195.110.41.9) Quit (Ping timeout: 480 seconds)
[20:21] * mlausch (~mlausch@2001:8d8:1fe:7:517f:ab4e:919:4374) has joined #ceph
[20:22] * dgurtner (~dgurtner@217-162-119-191.dynamic.hispeed.ch) Quit (Ping timeout: 480 seconds)
[20:24] * ChrisNBl_ (~ChrisNBlu@dhcp-ip-190.dorf.rwth-aachen.de) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[20:35] * TMM (~hp@178-84-46-106.dynamic.upc.nl) Quit (Ping timeout: 480 seconds)
[20:36] * jashank42 (~jashan42@61.0.108.143) Quit (Remote host closed the connection)
[20:40] * TMM (~hp@178-84-46-106.dynamic.upc.nl) has joined #ceph
[20:41] * murmur1 (~Kurimus@9S0AAAS56.tor-irc.dnsbl.oftc.net) Quit ()
[20:53] * vbellur (~vijay@122.172.46.139) Quit (Ping timeout: 480 seconds)
[20:56] * shnarch (~shnarch@2.52.139.92) Quit (Ping timeout: 480 seconds)
[21:11] * galaxyAbstractor (~LRWerewol@wannabe.torservers.net) has joined #ceph
[21:41] * galaxyAbstractor (~LRWerewol@8Q4AABCPY.tor-irc.dnsbl.oftc.net) Quit ()
[21:41] * Jourei (~Kayla@spftor1e1.privacyfoundation.ch) has joined #ceph
[21:50] * karnan (~karnan@223.239.244.139) Quit (Remote host closed the connection)
[21:57] * linjan (~linjan@80.179.241.26) has joined #ceph
[22:04] * jashank42 (~jashan42@117.197.174.88) has joined #ceph
[22:09] * chasmo77 (~chas77@158.183-62-69.ftth.swbr.surewest.net) Quit (Quit: It's just that easy)
[22:10] * DV (~veillard@2001:41d0:1:d478::1) Quit (Remote host closed the connection)
[22:10] * DV (~veillard@2001:41d0:a:f29f::1) has joined #ceph
[22:11] * Jourei (~Kayla@9S0AAAS9D.tor-irc.dnsbl.oftc.net) Quit ()
[22:11] * Jamana (~notarima@spftor1e1.privacyfoundation.ch) has joined #ceph
[22:21] * marrusl (~mark@cpe-24-90-46-248.nyc.res.rr.com) Quit (Quit: bye!)
[22:23] * wicope (~wicope@0001fd8a.user.oftc.net) Quit (Remote host closed the connection)
[22:33] * stiopa (~stiopa@cpc73828-dals21-2-0-cust630.20-2.cable.virginm.net) has joined #ceph
[22:33] * doppelgrau (~doppelgra@pd956d116.dip0.t-ipconnect.de) Quit (Quit: doppelgrau)
[22:33] * mykola (~Mikolaj@91.225.200.209) Quit (Quit: away)
[22:36] * TMM (~hp@178-84-46-106.dynamic.upc.nl) Quit (Ping timeout: 480 seconds)
[22:36] * stiopa (~stiopa@cpc73828-dals21-2-0-cust630.20-2.cable.virginm.net) Quit ()
[22:38] * stiopa (~stiopa@cpc73828-dals21-2-0-cust630.20-2.cable.virginm.net) has joined #ceph
[22:38] * stiopa (~stiopa@cpc73828-dals21-2-0-cust630.20-2.cable.virginm.net) Quit ()
[22:40] * stiopa (~stiopa@cpc73828-dals21-2-0-cust630.20-2.cable.virginm.net) has joined #ceph
[22:40] * sleinen (~Adium@ant06-2-78-238-20-117.fbx.proxad.net) has joined #ceph
[22:41] * Jamana (~notarima@5NZAADE3P.tor-irc.dnsbl.oftc.net) Quit ()
[22:41] * TMM (~hp@178-84-46-106.dynamic.upc.nl) has joined #ceph
[22:48] * yguang11_ (~yguang11@2001:4998:effd:7801::10fa) Quit (Remote host closed the connection)
[22:48] * sleinen (~Adium@ant06-2-78-238-20-117.fbx.proxad.net) Quit (Quit: Leaving.)
[22:48] * yguang11 (~yguang11@2001:4998:effd:7801::10fa) has joined #ceph
[22:48] * jashank42 (~jashan42@117.197.174.88) Quit (Remote host closed the connection)
[22:58] * jks (~jks@178.155.151.121) has joined #ceph
[23:10] * yguang11 (~yguang11@2001:4998:effd:7801::10fa) Quit (Ping timeout: 480 seconds)
[23:11] * Aramande_ (~vegas3@185.77.129.54) has joined #ceph
[23:16] * KevinPerks (~Adium@cpe-75-177-32-14.triad.res.rr.com) Quit (Quit: Leaving.)
[23:27] * linjan (~linjan@80.179.241.26) Quit (Ping timeout: 480 seconds)
[23:38] * burley (~khemicals@cpe-98-28-239-78.cinci.res.rr.com) has joined #ceph
[23:41] * Aramande_ (~vegas3@3OZAAB36M.tor-irc.dnsbl.oftc.net) Quit ()
[23:41] * pepzi (~allenmelo@5.61.34.63) has joined #ceph

These logs were automatically created by CephLogBot on irc.oftc.net using the Java IRC LogBot.