#ceph IRC Log

Index

IRC Log for 2015-05-26

Timestamps are in GMT/BST.

[0:01] * MentalRay (~MRay@107.171.161.165) Quit (Quit: This computer has gone to sleep)
[0:02] * MentalRay (~MRay@107.171.161.165) has joined #ceph
[0:02] * fsimonce (~simon@host11-35-dynamic.32-79-r.retail.telecomitalia.it) Quit (Quit: Coyote finally caught me)
[0:05] * VampiricPadraig (~Throlkim@8Q4AAA0PZ.tor-irc.dnsbl.oftc.net) has joined #ceph
[0:08] * vata1 (~vata@207.96.182.162) Quit (Ping timeout: 480 seconds)
[0:17] * sleinen1 (~Adium@2001:620:0:82::100) Quit (Ping timeout: 480 seconds)
[0:19] * badone (~brad@CPE-121-215-241-179.static.qld.bigpond.net.au) has joined #ceph
[0:26] * TranquilityBase (~oftc-webi@199.168.44.192) Quit (Remote host closed the connection)
[0:35] * VampiricPadraig (~Throlkim@8Q4AAA0PZ.tor-irc.dnsbl.oftc.net) Quit ()
[0:35] * osuka_1 (~utugi____@2WVAACLRH.tor-irc.dnsbl.oftc.net) has joined #ceph
[0:36] * JV (~chatzilla@204.14.239.18) Quit (Ping timeout: 480 seconds)
[0:37] * Kupo1 (~tyler.wil@23.111.254.159) Quit (Read error: Connection reset by peer)
[0:38] * Kupo1 (~tyler.wil@23.111.254.159) has joined #ceph
[0:44] * aarontc (~aarontc@2001:470:e893::1:1) has joined #ceph
[1:05] * osuka_1 (~utugi____@2WVAACLRH.tor-irc.dnsbl.oftc.net) Quit ()
[1:05] * tallest_red (~Vale@glados.quenelle.pw) has joined #ceph
[1:06] * i_m (~ivan.miro@nat-5-carp.hcn-strela.ru) has joined #ceph
[1:07] * fmanana (~fdmanana@bl13-148-61.dsl.telepac.pt) Quit (Ping timeout: 480 seconds)
[1:21] * oms101_ (~oms101@p20030057EA334500C6D987FFFE4339A1.dip0.t-ipconnect.de) Quit (Ping timeout: 480 seconds)
[1:28] * jidar (~jidar@r2d2.fap.me) has joined #ceph
[1:29] * oms101_ (~oms101@p20030057EA436700C6D987FFFE4339A1.dip0.t-ipconnect.de) has joined #ceph
[1:33] * linjan (~linjan@80.179.241.26) Quit (Ping timeout: 480 seconds)
[1:35] * badone_ (~brad@CPE-121-215-241-179.static.qld.bigpond.net.au) has joined #ceph
[1:35] * tallest_red (~Vale@8Q4AAA0QQ.tor-irc.dnsbl.oftc.net) Quit ()
[1:35] * elt (~tallest_r@192.87.28.28) has joined #ceph
[1:36] * jdillaman (~jdillaman@pool-108-18-97-82.washdc.fios.verizon.net) has joined #ceph
[1:38] * badone (~brad@CPE-121-215-241-179.static.qld.bigpond.net.au) Quit (Ping timeout: 480 seconds)
[1:41] * Kupo1 (~tyler.wil@23.111.254.159) Quit (Read error: Connection reset by peer)
[1:43] * Kupo1 (~tyler.wil@23.111.254.159) has joined #ceph
[1:46] * pdrakeweb (~pdrakeweb@cpe-65-185-74-239.neo.res.rr.com) has joined #ceph
[2:05] * elt (~tallest_r@5NZAACRDX.tor-irc.dnsbl.oftc.net) Quit ()
[2:05] * luckz (~bildramer@176.10.99.204) has joined #ceph
[2:31] * badone_ is now known as badone
[2:31] * jdillaman (~jdillaman@pool-108-18-97-82.washdc.fios.verizon.net) Quit (Quit: jdillaman)
[2:35] * luckz (~bildramer@5NZAACREE.tor-irc.dnsbl.oftc.net) Quit ()
[2:35] * neobenedict (~ZombieTre@exit1.telostor.ca) has joined #ceph
[2:40] * lucas1 (~Thunderbi@218.76.52.64) has joined #ceph
[2:46] * cmdrk (~lincoln@c-71-194-163-11.hsd1.il.comcast.net) Quit (Ping timeout: 480 seconds)
[2:50] * cmdrk (~lincoln@c-71-194-163-11.hsd1.il.comcast.net) has joined #ceph
[2:50] * madkiss1 (~madkiss@2001:6f8:12c3:f00f:b117:f3fa:63ba:f6c2) Quit (Ping timeout: 480 seconds)
[3:04] * yanzheng (~zhyan@125.71.106.160) has joined #ceph
[3:04] * madkiss (~madkiss@2001:6f8:12c3:f00f:e1f2:757c:977:ea63) has joined #ceph
[3:05] * neobenedict (~ZombieTre@5NZAACREU.tor-irc.dnsbl.oftc.net) Quit ()
[3:05] * mollstam (~Kayla@79.142.70.194) has joined #ceph
[3:07] * shyu (~Shanzhi@119.254.120.66) has joined #ceph
[3:07] * jekt (~jekt@96-59-92-248.res.bhn.net) Quit ()
[3:09] * yghannam (~yghannam@0001f8aa.user.oftc.net) has joined #ceph
[3:21] * Mika_c (~Mk@122.146.93.152) has joined #ceph
[3:25] * logan (~a@63.143.49.103) has joined #ceph
[3:35] * mollstam (~Kayla@79.142.70.194) Quit ()
[3:35] * MentalRay (~MRay@107.171.161.165) Quit (Quit: This computer has gone to sleep)
[3:35] * cmrn (~notarima@aurora.enn.lu) has joined #ceph
[3:45] * OutOfNoWhere (~rpb@199.68.195.102) Quit (Remote host closed the connection)
[3:46] * OutOfNoWhere (~rpb@199.68.195.102) has joined #ceph
[4:04] * macjack (~macjack@122.146.93.152) has joined #ceph
[4:05] * cmrn (~notarima@5NZAACRFT.tor-irc.dnsbl.oftc.net) Quit ()
[4:08] * vata (~vata@cable-21.246.173-197.electronicbox.net) Quit (Quit: Leaving.)
[4:10] * vata (~vata@cable-21.246.173-197.electronicbox.net) has joined #ceph
[4:18] * macjack (~macjack@122.146.93.152) Quit (Remote host closed the connection)
[4:22] * flisky (~Thunderbi@106.39.60.34) has joined #ceph
[4:25] * bkopilov (~bkopilov@bzq-79-179-39-86.red.bezeqint.net) Quit (Ping timeout: 480 seconds)
[4:29] * kefu (~kefu@114.86.210.96) has joined #ceph
[4:33] * JV (~chatzilla@static-50-53-42-60.bvtn.or.frontiernet.net) has joined #ceph
[4:33] * macjack (~macjack@122.146.93.152) has joined #ceph
[4:33] * zhaochao (~zhaochao@125.39.8.226) has joined #ceph
[4:33] * JV_ (~chatzilla@204.14.239.17) has joined #ceph
[4:35] * Vale (~Da_Pineap@exit-01c.noisetor.net) has joined #ceph
[4:41] * JV (~chatzilla@static-50-53-42-60.bvtn.or.frontiernet.net) Quit (Ping timeout: 480 seconds)
[4:59] * burley (~khemicals@cpe-98-28-239-78.cinci.res.rr.com) has joined #ceph
[5:05] * Vale (~Da_Pineap@8Q4AAA0T9.tor-irc.dnsbl.oftc.net) Quit ()
[5:05] * rikai1 (~dotblank@orilla.enn.lu) has joined #ceph
[5:13] * evl (~chatzilla@139.216.138.39) has joined #ceph
[5:19] * calvinx (~calvin@101.100.172.246) has joined #ceph
[5:19] * carmstrong (sid22558@id-22558.highgate.irccloud.com) Quit (Ping timeout: 480 seconds)
[5:23] * overclk (~overclk@121.244.87.117) has joined #ceph
[5:23] * carmstrong (sid22558@id-22558.highgate.irccloud.com) has joined #ceph
[5:26] * calvinx (~calvin@101.100.172.246) Quit (Quit: calvinx)
[5:26] * kefu (~kefu@114.86.210.96) Quit (Max SendQ exceeded)
[5:26] * calvinx (~calvin@101.100.172.246) has joined #ceph
[5:27] * calvinx (~calvin@101.100.172.246) Quit ()
[5:27] * kefu (~kefu@114.86.210.96) has joined #ceph
[5:27] * calvinx (~calvin@101.100.172.246) has joined #ceph
[5:27] * calvinx (~calvin@101.100.172.246) Quit ()
[5:28] * calvinx (~calvin@101.100.172.246) has joined #ceph
[5:35] * rikai1 (~dotblank@3OZAABV7Y.tor-irc.dnsbl.oftc.net) Quit ()
[5:39] * Vacuum__ (~Vacuum@i59F79C45.versanet.de) has joined #ceph
[5:43] * kanagaraj (~kanagaraj@121.244.87.117) has joined #ceph
[5:43] * shang (~ShangWu@175.41.48.77) has joined #ceph
[5:46] * Vacuum_ (~Vacuum@i59F79C30.versanet.de) Quit (Ping timeout: 480 seconds)
[5:48] * JV_ (~chatzilla@204.14.239.17) Quit (Ping timeout: 480 seconds)
[5:54] * yghannam (~yghannam@0001f8aa.user.oftc.net) Quit (Ping timeout: 480 seconds)
[5:55] * deepsa (~Deependra@00013525.user.oftc.net) has joined #ceph
[6:07] * madkiss1 (~madkiss@2001:6f8:12c3:f00f:a14e:d843:ebf3:1930) has joined #ceph
[6:10] * puvo (~Inuyasha@tor-exit.jinetic.net) has joined #ceph
[6:10] * shylesh (~shylesh@121.244.87.124) has joined #ceph
[6:12] * KevinPerks (~Adium@cpe-75-177-32-14.triad.res.rr.com) Quit (Quit: Leaving.)
[6:13] * bkopilov (~bkopilov@nat-pool-tlv-t.redhat.com) has joined #ceph
[6:13] * madkiss (~madkiss@2001:6f8:12c3:f00f:e1f2:757c:977:ea63) Quit (Ping timeout: 480 seconds)
[6:19] * amote (~amote@121.244.87.116) has joined #ceph
[6:28] * MACscr (~Adium@2601:d:c800:de3:b809:9881:1fa8:2f06) Quit (Quit: Leaving.)
[6:31] * derjohn_mob (~aj@tmo-113-47.customers.d1-online.com) Quit (Ping timeout: 480 seconds)
[6:40] * puvo (~Inuyasha@2WVAACLXS.tor-irc.dnsbl.oftc.net) Quit ()
[6:44] * deepsa (~Deependra@00013525.user.oftc.net) Quit (Ping timeout: 480 seconds)
[6:48] * vata (~vata@cable-21.246.173-197.electronicbox.net) Quit (Quit: Leaving.)
[6:49] * i_m (~ivan.miro@nat-5-carp.hcn-strela.ru) Quit (Ping timeout: 480 seconds)
[7:10] * rhonabwy (~oracular@ncc-1701-a.tor-exit.network) has joined #ceph
[7:11] * logan (~a@63.143.49.103) Quit (Ping timeout: 480 seconds)
[7:15] * i_m (~ivan.miro@nat-5-carp.hcn-strela.ru) has joined #ceph
[7:22] * kefu (~kefu@114.86.210.96) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[7:23] * chasmo77 (~chas77@158.183-62-69.ftth.swbr.surewest.net) has joined #ceph
[7:29] * gardensh_ (~gardenshe@90.216.134.197) has joined #ceph
[7:29] * karnan (~karnan@121.244.87.117) has joined #ceph
[7:32] * gardens__ (~gardenshe@176.27.51.101) has joined #ceph
[7:33] * deepsa (~Deependra@00013525.user.oftc.net) has joined #ceph
[7:39] * flisky (~Thunderbi@106.39.60.34) Quit (Quit: flisky)
[7:40] * rhonabwy (~oracular@8Q4AAA0XC.tor-irc.dnsbl.oftc.net) Quit ()
[7:40] * gardensh_ (~gardenshe@90.216.134.197) Quit (Ping timeout: 480 seconds)
[7:40] * Esvandiary (~zc00gii@ncc-1701-a.tor-exit.network) has joined #ceph
[7:41] * gardens__ (~gardenshe@176.27.51.101) Quit (Remote host closed the connection)
[7:44] * gaveen (~gaveen@175.157.57.186) has joined #ceph
[7:48] * derjohn_mob (~aj@88.128.80.134) has joined #ceph
[7:50] * vbellur (~vijay@121.244.87.117) has joined #ceph
[8:01] * shang (~ShangWu@175.41.48.77) Quit (Quit: Ex-Chat)
[8:07] * flisky (~Thunderbi@106.39.60.34) has joined #ceph
[8:10] * Esvandiary (~zc00gii@5NZAACRKR.tor-irc.dnsbl.oftc.net) Quit ()
[8:10] * Kyso (~Kalado@exit1.ipredator.se) has joined #ceph
[8:14] * cok (~chk@2a02:2350:18:1010:d1b9:9010:e43e:f73d) has joined #ceph
[8:15] * rdas (~rdas@121.244.87.116) has joined #ceph
[8:16] * zack_dolby (~textual@pa3b3a1.tokynt01.ap.so-net.ne.jp) Quit (Quit: My MacBook has gone to sleep. ZZZzzz???)
[8:17] * zack_dolby (~textual@pa3b3a1.tokynt01.ap.so-net.ne.jp) has joined #ceph
[8:17] * zack_dolby (~textual@pa3b3a1.tokynt01.ap.so-net.ne.jp) Quit ()
[8:19] * pvh_sa (~pvh@105.210.174.225) Quit (Ping timeout: 480 seconds)
[8:26] * Nacer (~Nacer@2001:41d0:fe82:7200:e1d6:5f7d:af2c:19e3) Quit (Remote host closed the connection)
[8:26] * shohn (~shohn@dslb-094-223-166-015.094.223.pools.vodafone-ip.de) has joined #ceph
[8:31] * MACscr (~Adium@2601:d:c800:de3:3040:1ef4:e2e4:9c69) has joined #ceph
[8:32] * pvh_sa (~pvh@105.210.174.225) has joined #ceph
[8:33] * sep (~sep@2a04:2740:1:0:52e5:49ff:feeb:32) has joined #ceph
[8:34] * wicope (~wicope@0001fd8a.user.oftc.net) has joined #ceph
[8:34] * JV (~chatzilla@static-50-53-42-60.bvtn.or.frontiernet.net) has joined #ceph
[8:34] * wicope_ (~wicope@4.Red-83-47-175.dynamicIP.rima-tde.net) has joined #ceph
[8:35] * wicope_ (~wicope@4.Red-83-47-175.dynamicIP.rima-tde.net) Quit (Remote host closed the connection)
[8:37] * derjohn_mob (~aj@88.128.80.134) Quit (Ping timeout: 480 seconds)
[8:40] * Kyso (~Kalado@7R2AAA955.tor-irc.dnsbl.oftc.net) Quit ()
[8:40] * ahmeni (~Behedwin@176.10.99.203) has joined #ceph
[8:42] * pvh_sa (~pvh@105.210.174.225) Quit (Ping timeout: 480 seconds)
[8:44] * rotbeard (~redbeard@aftr-95-222-26-136.unity-media.net) Quit (Quit: Leaving)
[8:48] * dopesong (~dopesong@lb1.mailer.data.lt) has joined #ceph
[8:49] * T1w (~jens@node3.survey-it.dk) has joined #ceph
[8:49] * JV (~chatzilla@static-50-53-42-60.bvtn.or.frontiernet.net) Quit (Ping timeout: 480 seconds)
[8:49] * Kioob`Taff (~plug-oliv@2a01:e35:2e8a:1e0::42:10) has joined #ceph
[8:49] * DV_ (~veillard@2001:41d0:1:d478::1) Quit (Ping timeout: 480 seconds)
[8:49] * DV_ (~veillard@2001:41d0:1:d478::1) has joined #ceph
[8:50] * b0e (~aledermue@213.95.25.82) has joined #ceph
[8:51] * gardenshed (~gardenshe@176.27.51.101) has joined #ceph
[8:59] * shang (~ShangWu@175.41.48.77) has joined #ceph
[8:59] * gardenshed (~gardenshe@176.27.51.101) Quit (Ping timeout: 480 seconds)
[8:59] * owasserm (~owasserm@52D9864F.cm-11-1c.dynamic.ziggo.nl) has joined #ceph
[9:01] * owasserm (~owasserm@52D9864F.cm-11-1c.dynamic.ziggo.nl) Quit ()
[9:02] * kawa2014 (~kawa@87.253.116.96) has joined #ceph
[9:02] * owasserm (~owasserm@52D9864F.cm-11-1c.dynamic.ziggo.nl) has joined #ceph
[9:06] * logan (~a@63.143.49.103) has joined #ceph
[9:09] * jordanP (~jordan@213.215.2.194) has joined #ceph
[9:10] * ahmeni (~Behedwin@5NZAACRMB.tor-irc.dnsbl.oftc.net) Quit ()
[9:12] * barnim (~redbeard@2a02:908:df10:d300:76f0:6dff:fe3b:994d) Quit (Quit: Verlassend)
[9:12] * i_m (~ivan.miro@nat-5-carp.hcn-strela.ru) Quit (Read error: Connection reset by peer)
[9:12] * i_m (~ivan.miro@nat-5-carp.hcn-strela.ru) has joined #ceph
[9:13] * evl (~chatzilla@139.216.138.39) Quit (Quit: ChatZilla 0.9.91.1 [Firefox 38.0.1/20150518070256])
[9:16] * Hemanth (~Hemanth@121.244.87.117) has joined #ceph
[9:18] * logan (~a@63.143.49.103) Quit (Ping timeout: 480 seconds)
[9:19] * derjohn_mob (~aj@fw.gkh-setu.de) has joined #ceph
[9:23] * Kupo1 (~tyler.wil@23.111.254.159) Quit (Read error: Connection reset by peer)
[9:23] * DV_ (~veillard@2001:41d0:1:d478::1) Quit (Ping timeout: 480 seconds)
[9:24] * kefu (~kefu@114.86.210.96) has joined #ceph
[9:25] * shang (~ShangWu@175.41.48.77) Quit (Ping timeout: 480 seconds)
[9:25] * Kupo1 (~tyler.wil@23.111.254.159) has joined #ceph
[9:32] * DV_ (~veillard@2001:41d0:a:f29f::1) has joined #ceph
[9:32] * nils_ (~nils@doomstreet.collins.kg) has joined #ceph
[9:33] * Concubidated (~Adium@c-98-232-31-52.hsd1.wa.comcast.net) has joined #ceph
[9:35] * shang (~ShangWu@175.41.48.77) has joined #ceph
[9:35] * fridim_ (~fridim@56-198-190-109.dsl.ovh.fr) has joined #ceph
[9:40] * analbeard (~shw@support.memset.com) has joined #ceph
[9:40] * spate (~delcake@176.10.99.207) has joined #ceph
[9:44] * fsimonce (~simon@host11-35-dynamic.32-79-r.retail.telecomitalia.it) has joined #ceph
[9:45] * Nacer (~Nacer@252-87-190-213.intermediasud.com) has joined #ceph
[9:46] * owasserm (~owasserm@52D9864F.cm-11-1c.dynamic.ziggo.nl) Quit (Quit: Ex-Chat)
[9:46] * TMM (~hp@178-84-46-106.dynamic.upc.nl) Quit (Ping timeout: 480 seconds)
[9:46] * owasserm (~owasserm@52D9864F.cm-11-1c.dynamic.ziggo.nl) has joined #ceph
[9:52] * bitserker (~toni@188.87.126.203) has joined #ceph
[9:58] * pvh_sa (~pvh@uwcfw.uwc.ac.za) has joined #ceph
[10:09] * nsoffer (~nsoffer@nat-pool-tlv-t.redhat.com) has joined #ceph
[10:10] * spate (~delcake@8Q4AAA01L.tor-irc.dnsbl.oftc.net) Quit ()
[10:10] * Esge (~Blueraven@tor-exit2-readme.puckey.org) has joined #ceph
[10:16] * linjan (~linjan@195.110.41.9) has joined #ceph
[10:17] * Nacer (~Nacer@252-87-190-213.intermediasud.com) Quit (Remote host closed the connection)
[10:18] * TMM (~hp@sams-office-nat.tomtomgroup.com) has joined #ceph
[10:18] * gardenshed (~gardenshe@90.216.134.198) has joined #ceph
[10:18] * rotbeard (~redbeard@x5f7528eb.dyn.telefonica.de) has joined #ceph
[10:19] * Concubidated (~Adium@c-98-232-31-52.hsd1.wa.comcast.net) Quit (Quit: Leaving.)
[10:21] * Sysadmin88 (~IceChat77@054527d3.skybroadband.com) Quit (Quit: ASCII a stupid question, get a stupid ANSI!)
[10:31] * zack_dolby (~textual@pw126205031178.3.panda-world.ne.jp) has joined #ceph
[10:33] * Nacer (~Nacer@252-87-190-213.intermediasud.com) has joined #ceph
[10:35] * fmanana (~fdmanana@bl13-148-61.dsl.telepac.pt) has joined #ceph
[10:39] * bitserker (~toni@188.87.126.203) Quit (Ping timeout: 480 seconds)
[10:40] * Esge (~Blueraven@7R2AABABK.tor-irc.dnsbl.oftc.net) Quit ()
[10:40] * dotblank (~SurfMaths@aurora.enn.lu) has joined #ceph
[10:42] * sankarshan (~sankarsha@121.244.87.117) has joined #ceph
[10:47] * gfidente (~oftc-webi@net-2-39-191-203.cust.vodafonedsl.it) has joined #ceph
[10:49] <gfidente> hi guys, I am experimenting with a simple cluster made up of 1 mon a 3 osds
[10:50] <gfidente> I created a couple of pools with size = 3 and min_size = 1
[10:50] <gfidente> everything works as expected as long as the 3 osds are up and running, but if I bring down one of the three osds
[10:50] <gfidente> (note, each running on a separate host)
[10:51] <gfidente> all the pools refuse writes after a 300secs timeout
[10:51] <daviddcc> Hi gfidente min_size ?
[10:51] <gfidente> and ceph df switches MAX_AVAIL to 0 for all pools
[10:51] <gfidente> daviddcc: hi there, thanks for helping :)
[10:51] <daviddcc> "Exact" :)
[10:51] <gfidente> daviddcc: ceph osd pool $name get min_size returns min_size: 1
[10:52] <daviddcc> ok
[10:53] <gfidente> daviddcc: I can see in the ceph.log a message saying log [INF] : osd.1 out (down for 303.944620)
[10:53] <gfidente> from what I understand at that point the other osds should attempt to find a new peer ... but they won't because they were 3 in total
[10:53] * jprovazn (~jprovazn@213.175.37.10) has joined #ceph
[10:53] <gfidente> so the cluster goes into active+degraded state as expected
[10:54] <gfidente> and accepts writes until the 300secs timeout
[10:54] <gfidente> at which point MAX_AVAIL goes to 0 for all pools
[10:54] <gfidente> I am not sure if this is the expected behaviour based on some config setting or if it is misbehaving
[10:57] <daviddcc> In a normal infra, it must rebalance the oid after 5min
[10:57] <daviddcc> But should not stop.
[10:57] <daviddcc> interesting
[10:58] <gfidente> so I think in this scenario it won't be able to rebalance
[10:58] <gfidente> because we had 3 osds in total and size = 3
[10:58] <gfidente> which makes me wonder, is it right to expect it carrying on operations with up to 1 osd running (given size = 1)?
[10:59] <gfidente> (given min_size = 1)
[11:00] <daviddcc> All pages are active+degraded ?
[11:02] * logan (~a@63.143.49.103) has joined #ceph
[11:04] * pvh_sa (~pvh@uwcfw.uwc.ac.za) Quit (Ping timeout: 480 seconds)
[11:04] * branto (~branto@ip-213-220-214-203.net.upcbroadband.cz) has left #ceph
[11:05] <gfidente> daviddcc: pages or pgs?
[11:05] <daviddcc> pgs
[11:05] <daviddcc> pg
[11:05] <gfidente> sorry but I honestly lack knowledge so I might very well ignore some settings
[11:05] <gfidente> now, all pgs are into active+degraded yes
[11:06] <gfidente> well the list is pretty long, but it looks like
[11:08] * jcsp (~Adium@82-71-16-249.dsl.in-addr.zen.co.uk) has joined #ceph
[11:10] * Be-El (~quassel@fb08-bcf-pc01.computational.bio.uni-giessen.de) has joined #ceph
[11:10] * dotblank (~SurfMaths@5NZAACRQI.tor-irc.dnsbl.oftc.net) Quit ()
[11:11] <Be-El> hi
[11:12] <daviddcc> If an OSD is down and the degraded condition persists, Ceph may mark the down OSD as out of the cluster and remap the data from the down OSD to another OSD. The time between being marked down and being marked out is controlled by mon osd down out interval, which is set to 300 seconds by default.
[11:12] <daviddcc> A placement group can also be degraded, because Ceph cannot find one or more objects that Ceph thinks should be in the placement group. While you cannot read or write to unfound objects, you can still access all of the other objects in the degraded placement group.
[11:13] * Nacer (~Nacer@252-87-190-213.intermediasud.com) Quit (Remote host closed the connection)
[11:13] <daviddcc> gfidente, ceph osd tree ?
[11:17] <gfidente> daviddcc: http://paste.openstack.org/show/237429/ and thanks again
[11:17] * haomaiwang (~haomaiwan@114.111.166.250) Quit (Remote host closed the connection)
[11:24] * spow (~spow@95.45.132.206) has joined #ceph
[11:25] * bitserker (~toni@63.pool85-52-240.static.orange.es) has joined #ceph
[11:25] <gfidente> daviddcc: even more interesting, if I set size = 2 for all pools, start with 3 osds and bring one of them down
[11:25] <gfidente> after the 300secs timeout, ceph df still reporting MAX_AVAIL 0 for all pools
[11:26] <gfidente> despite having 2 osds still up and in!
[11:26] <gfidente> can this be related to the crushmap somehow?
[11:27] <gfidente> and despite ceph status reporting active+clean
[11:28] * badone (~brad@CPE-121-215-241-179.static.qld.bigpond.net.au) Quit (Ping timeout: 480 seconds)
[11:29] * Nacer (~Nacer@252-87-190-213.intermediasud.com) has joined #ceph
[11:29] <spow> anybody knows about fs metadata issues with 0.94.1?
[11:31] <spow> ls -la is immediate from the client that created the files and lags hugely from other clients; this happen with every dir
[11:31] <daviddcc> gfidente, http://tracker.ceph.com/issues/10257
[11:32] * pvh_sa (~pvh@41.164.8.114) has joined #ceph
[11:32] * cok (~chk@2a02:2350:18:1010:d1b9:9010:e43e:f73d) Quit (Quit: Leaving.)
[11:33] <gfidente> daviddcc: hehe indeed seems to be the case
[11:33] <gfidente> daviddcc: I am unsure about the rulesets thing
[11:36] <gfidente> because I am using most probably just the default ruleset
[11:39] * ngoswami (~ngoswami@121.244.87.116) has joined #ceph
[11:40] * Frostshifter (~puvo@89.105.194.83) has joined #ceph
[11:42] * badone (~brad@CPE-121-215-241-179.static.qld.bigpond.net.au) has joined #ceph
[11:42] * sugoruyo (~georgev@paarthurnax.esc.rl.ac.uk) has joined #ceph
[11:43] <daviddcc> gfidente, ceph-osd --version ?
[11:44] <daviddcc> Backport changed from giant,firefly,dumpling to giant,firefly
[11:53] * treenerd (~treenerd@85.193.140.98) has joined #ceph
[11:55] <gfidente> daviddcc: ceph version 0.80.7 (6c0127fcb58008793d3c8b62d925bc91963672a3)
[12:03] <daviddcc> gfi
[12:04] <daviddcc> gfidente, the bug was not corrected in this version.
[12:04] <gfidente> daviddcc: looks like the bug, I created a ruleset with a single osd, bound a pool to it, brought down another of the 3 osds and indeed
[12:04] <gfidente> while the other pools reported MAX_AVAIL 0 the one bound to the single running osd didn't
[12:04] <gfidente> thanks a lot for guidance :)
[12:06] * haomaiwang (~haomaiwan@111.193.228.203) has joined #ceph
[12:07] <daviddcc> ;)
[12:07] * sjm (~sjm@pool-173-70-76-86.nwrknj.fios.verizon.net) has joined #ceph
[12:09] * shohn (~shohn@dslb-094-223-166-015.094.223.pools.vodafone-ip.de) has left #ceph
[12:10] * Frostshifter (~puvo@3OZAABWGB.tor-irc.dnsbl.oftc.net) Quit ()
[12:10] * brannmar (~mollstam@ncc-1701-a.tor-exit.network) has joined #ceph
[12:20] * raw (~raw@5.79.71.195) has joined #ceph
[12:21] * Nacer (~Nacer@252-87-190-213.intermediasud.com) Quit (Remote host closed the connection)
[12:25] * Nacer (~Nacer@252-87-190-213.intermediasud.com) has joined #ceph
[12:26] * Nacer (~Nacer@252-87-190-213.intermediasud.com) Quit (Remote host closed the connection)
[12:37] * sleinen (~Adium@macsl.switch.ch) has joined #ceph
[12:39] * ira (~ira@c-71-233-225-22.hsd1.ma.comcast.net) has joined #ceph
[12:40] * brannmar (~mollstam@0SGAAA0GK.tor-irc.dnsbl.oftc.net) Quit ()
[12:40] * VampiricPadraig (~Jones@37.187.129.166) has joined #ceph
[12:42] * Nacer (~Nacer@252-87-190-213.intermediasud.com) has joined #ceph
[12:43] * shyu (~Shanzhi@119.254.120.66) Quit (Remote host closed the connection)
[12:44] * OutOfNoWhere (~rpb@199.68.195.102) Quit (Ping timeout: 480 seconds)
[12:48] * fmanana (~fdmanana@bl13-148-61.dsl.telepac.pt) Quit (Ping timeout: 480 seconds)
[12:48] * kefu (~kefu@114.86.210.96) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[12:57] * bduncan (~bduncan@0002008a.user.oftc.net) has joined #ceph
[12:57] * kefu (~kefu@114.86.210.96) has joined #ceph
[12:58] * shang (~ShangWu@175.41.48.77) Quit (Remote host closed the connection)
[13:06] * fmanana (~fdmanana@bl13-148-61.dsl.telepac.pt) has joined #ceph
[13:10] * VampiricPadraig (~Jones@53IAABDU1.tor-irc.dnsbl.oftc.net) Quit ()
[13:10] * hyst (~jakekosbe@37.187.129.166) has joined #ceph
[13:11] * bduncan (~bduncan@0002008a.user.oftc.net) Quit (Ping timeout: 480 seconds)
[13:16] * cok (~chk@nat-cph1-sys.net.one.com) has joined #ceph
[13:18] * sjm (~sjm@pool-173-70-76-86.nwrknj.fios.verizon.net) Quit (Quit: Leaving.)
[13:18] * sjm (~sjm@pool-173-70-76-86.nwrknj.fios.verizon.net) has joined #ceph
[13:19] * fmanana (~fdmanana@bl13-148-61.dsl.telepac.pt) Quit (Ping timeout: 480 seconds)
[13:25] * cok (~chk@nat-cph1-sys.net.one.com) Quit (Quit: Leaving.)
[13:34] * nsoffer (~nsoffer@nat-pool-tlv-t.redhat.com) Quit (Ping timeout: 480 seconds)
[13:36] * gardenshed (~gardenshe@90.216.134.198) Quit (Ping timeout: 480 seconds)
[13:38] * flisky (~Thunderbi@106.39.60.34) Quit (Quit: flisky)
[13:39] * KevinPerks (~Adium@cpe-75-177-32-14.triad.res.rr.com) has joined #ceph
[13:40] * hyst (~jakekosbe@53IAABDWE.tor-irc.dnsbl.oftc.net) Quit ()
[13:40] * legion (~Kalado@tor2.stud.hig.no) has joined #ceph
[13:40] * haomaiwang (~haomaiwan@111.193.228.203) Quit (Remote host closed the connection)
[13:41] * jprovazn (~jprovazn@213.175.37.10) has left #ceph
[13:46] * zack_dolby (~textual@pw126205031178.3.panda-world.ne.jp) Quit (Quit: My MacBook has gone to sleep. ZZZzzz???)
[13:46] * zack_dolby (~textual@pw126205031178.3.panda-world.ne.jp) has joined #ceph
[13:46] * gardenshed (~gardenshe@90.216.134.194) has joined #ceph
[13:49] * zack_dolby (~textual@pw126205031178.3.panda-world.ne.jp) Quit (Read error: Connection reset by peer)
[13:52] * arcimboldo (~antonio@130.60.144.162) has joined #ceph
[13:56] * Nacer (~Nacer@252-87-190-213.intermediasud.com) Quit (Remote host closed the connection)
[13:57] <loicd> daviddcc: missing required features 1000000000000 suggests the kernel does not have the features required by your cluster
[13:58] * bitserker (~toni@63.pool85-52-240.static.orange.es) Quit (Ping timeout: 480 seconds)
[14:00] * sleinen1 (~Adium@2001:620:0:2d:7ed1:c3ff:fedc:3223) has joined #ceph
[14:06] * vbellur (~vijay@121.244.87.117) Quit (Ping timeout: 480 seconds)
[14:07] * sleinen (~Adium@macsl.switch.ch) Quit (Ping timeout: 480 seconds)
[14:10] * legion (~Kalado@53IAABDXF.tor-irc.dnsbl.oftc.net) Quit ()
[14:10] * jcsp1 (~Adium@82-71-16-249.dsl.in-addr.zen.co.uk) has joined #ceph
[14:10] * ItsCriminalAFK (~AG_Clinto@wannabe.torservers.net) has joined #ceph
[14:11] * badone (~brad@CPE-121-215-241-179.static.qld.bigpond.net.au) Quit (Ping timeout: 480 seconds)
[14:11] * jcsp (~Adium@0001bf3a.user.oftc.net) Quit (Ping timeout: 480 seconds)
[14:12] * bitserker (~toni@63.pool85-52-240.static.orange.es) has joined #ceph
[14:13] * jdillaman (~jdillaman@pool-108-18-97-82.washdc.fios.verizon.net) has joined #ceph
[14:15] * treenerd (~treenerd@85.193.140.98) Quit (Ping timeout: 480 seconds)
[14:15] * kanagaraj (~kanagaraj@121.244.87.117) Quit (Ping timeout: 480 seconds)
[14:16] * logan (~a@63.143.49.103) Quit (Ping timeout: 480 seconds)
[14:18] * shylesh (~shylesh@121.244.87.124) Quit (Remote host closed the connection)
[14:18] * t0rn (~ssullivan@2607:fad0:32:a02:56ee:75ff:fe48:3bd3) has joined #ceph
[14:19] * t0rn (~ssullivan@2607:fad0:32:a02:56ee:75ff:fe48:3bd3) has left #ceph
[14:24] * shohn (~shohn@dslb-094-223-166-015.094.223.pools.vodafone-ip.de) has joined #ceph
[14:26] * Nacer (~Nacer@252-87-190-213.intermediasud.com) has joined #ceph
[14:26] * treenerd (~treenerd@85.193.140.98) has joined #ceph
[14:27] * kanagaraj (~kanagaraj@121.244.87.117) has joined #ceph
[14:29] * gardenshed (~gardenshe@90.216.134.194) Quit (Remote host closed the connection)
[14:31] * gfidente (~oftc-webi@net-2-39-191-203.cust.vodafonedsl.it) Quit (Quit: Page closed)
[14:32] * fmanana (~fdmanana@bl13-148-61.dsl.telepac.pt) has joined #ceph
[14:35] * wschulze (~wschulze@cpe-69-206-242-231.nyc.res.rr.com) has joined #ceph
[14:35] * vbellur (~vijay@122.172.17.214) has joined #ceph
[14:37] * bkopilov (~bkopilov@nat-pool-tlv-t.redhat.com) Quit (Ping timeout: 480 seconds)
[14:38] * dneary (~dneary@nat-pool-bos-u.redhat.com) has joined #ceph
[14:40] * ItsCriminalAFK (~AG_Clinto@5NZAACRV4.tor-irc.dnsbl.oftc.net) Quit ()
[14:40] * Sun7zu (~Swompie`@hessel0.torservers.net) has joined #ceph
[14:46] * cok (~chk@nat-cph1-sys.net.one.com) has joined #ceph
[14:47] * zhaochao (~zhaochao@125.39.8.226) Quit (Quit: ChatZilla 0.9.91.1 [Iceweasel 38.0.1/20150519050911])
[14:57] * marrusl (~mark@cpe-24-90-46-248.nyc.res.rr.com) has joined #ceph
[15:00] * kefu (~kefu@114.86.210.96) Quit (Max SendQ exceeded)
[15:01] * tupper (~tcole@2001:420:2280:1272:8900:f9b8:3b49:567e) has joined #ceph
[15:01] * kefu (~kefu@114.86.210.96) has joined #ceph
[15:02] * gardenshed (~gardenshe@90.216.134.194) has joined #ceph
[15:03] * gardenshed (~gardenshe@90.216.134.194) Quit (Remote host closed the connection)
[15:04] * gardenshed (~gardenshe@90.216.134.194) has joined #ceph
[15:05] * kefu (~kefu@114.86.210.96) Quit (Max SendQ exceeded)
[15:06] * kefu (~kefu@114.86.210.96) has joined #ceph
[15:06] * deepsa (~Deependra@00013525.user.oftc.net) Quit (Quit: Textual IRC Client: www.textualapp.com)
[15:08] * karnan (~karnan@121.244.87.117) Quit (Remote host closed the connection)
[15:09] * tserong (~tserong@203-214-92-220.dyn.iinet.net.au) Quit (Ping timeout: 480 seconds)
[15:10] * Sun7zu (~Swompie`@53IAABDZU.tor-irc.dnsbl.oftc.net) Quit ()
[15:10] * Lunk2 (~Da_Pineap@wannabe.torservers.net) has joined #ceph
[15:12] * brad_mssw (~brad@66.129.88.50) has joined #ceph
[15:13] * linjan (~linjan@195.110.41.9) Quit (Remote host closed the connection)
[15:13] * rlrevell (~leer@vbo1.inmotionhosting.com) has joined #ceph
[15:15] * linjan (~linjan@195.110.41.9) has joined #ceph
[15:15] * Kingrat (~shiny@cpe-96-29-149-153.kya.res.rr.com) Quit (Remote host closed the connection)
[15:20] * primechuck (~primechuc@host-95-2-129.infobunker.com) has joined #ceph
[15:20] * dougf (~dougf@96-38-99-179.dhcp.jcsn.tn.charter.com) Quit (Read error: Connection reset by peer)
[15:21] * logan (~a@63.143.49.103) has joined #ceph
[15:22] * tserong (~tserong@203-214-92-220.dyn.iinet.net.au) has joined #ceph
[15:23] * dougf (~dougf@96-38-99-179.dhcp.jcsn.tn.charter.com) has joined #ceph
[15:23] * amote (~amote@121.244.87.116) Quit (Quit: Leaving)
[15:25] * primechuck (~primechuc@host-95-2-129.infobunker.com) Quit (Read error: No route to host)
[15:25] * primechuck (~primechuc@host-95-2-129.infobunker.com) has joined #ceph
[15:25] * ira (~ira@c-71-233-225-22.hsd1.ma.comcast.net) Quit (Remote host closed the connection)
[15:27] * linuxkidd (~linuxkidd@42.sub-70-193-59.myvzw.com) has joined #ceph
[15:27] * yanzheng (~zhyan@125.71.106.160) Quit (Quit: This computer has gone to sleep)
[15:27] * yanzheng (~zhyan@125.71.106.160) has joined #ceph
[15:28] * ira (~ira@c-71-233-225-22.hsd1.ma.comcast.net) has joined #ceph
[15:29] * nhm (~nhm@184-97-242-33.mpls.qwest.net) has joined #ceph
[15:29] * ChanServ sets mode +o nhm
[15:29] * overclk (~overclk@121.244.87.117) Quit (Quit: Leaving)
[15:30] * tserong (~tserong@203-214-92-220.dyn.iinet.net.au) Quit (Ping timeout: 480 seconds)
[15:32] * branto (~branto@ip-213-220-214-203.net.upcbroadband.cz) has joined #ceph
[15:32] * championofcyrodi (~championo@50-205-35-98-static.hfc.comcastbusiness.net) Quit (Remote host closed the connection)
[15:33] * ganders (~root@190.2.42.21) has joined #ceph
[15:34] * DV__ (~veillard@2001:41d0:1:d478::1) has joined #ceph
[15:34] <ganders> hi guys, i want to add a new cache pool to my existing ceph conf cluster, i've 4 osd servers, each has 9 osd, and then i got 3 SSD disks on each server, so my idea is to create a cache-pool with 3 ssd's per osd server
[15:35] <ganders> so far i've:
[15:35] * DV_ (~veillard@2001:41d0:a:f29f::1) Quit (Remote host closed the connection)
[15:35] <ganders> http://pastebin.com/raw.php?i=wiEhtf0f
[15:36] <ganders> cephosd04-ssd is a new bucket that contains 3 ssds (osd.36, 37 and 38), they are mounted on the cephosd04 server, but.. still not 'started'
[15:36] * Nacer (~Nacer@252-87-190-213.intermediasud.com) Quit (Remote host closed the connection)
[15:37] * dyasny (~dyasny@173.231.115.58) has joined #ceph
[15:37] * Hemanth (~Hemanth@121.244.87.117) Quit (Ping timeout: 480 seconds)
[15:37] <Be-El> ganders: how did you add the new osds and what does the logs for those osd say?
[15:37] * kefu (~kefu@114.86.210.96) Quit (Max SendQ exceeded)
[15:38] <ganders> my crush algo is: http://pastebin.com/raw.php?i=h46PDybf
[15:38] <ganders> Be-El: the new osds I just add then with the following steps:
[15:38] * kefu (~kefu@114.86.210.96) has joined #ceph
[15:38] * championofcyrodi (~championo@50-205-35-98-static.hfc.comcastbusiness.net) has joined #ceph
[15:39] * nsoffer (~nsoffer@nat-pool-tlv-t.redhat.com) has joined #ceph
[15:40] * Lunk2 (~Da_Pineap@7R2AABALB.tor-irc.dnsbl.oftc.net) Quit ()
[15:40] * pvh_sa (~pvh@41.164.8.114) Quit (Ping timeout: 480 seconds)
[15:40] * Rens2Sea (~smf68@ncc-1701-a.tor-exit.network) has joined #ceph
[15:40] * DV__ (~veillard@2001:41d0:1:d478::1) Quit (Remote host closed the connection)
[15:41] <ganders> Be-El: http://pastebin.com/raw.php?i=Gc9t7kbm
[15:41] * harold (~hamiller@71-94-227-123.dhcp.mdfd.or.charter.com) has joined #ceph
[15:41] <ganders> the thing is that if i start the osd daemon... with "sudo start ceph-osd id=36"... the daemon start... but.. it will 'plug' into the bucket cephosd04 instead of cephosd04-ssd
[15:42] * lucas1 (~Thunderbi@218.76.52.64) Quit (Quit: lucas1)
[15:42] <ganders> i've already create the new cache-pool, and associated with the existing 'cold-pool'
[15:42] * lucas1 (~Thunderbi@218.76.52.64) has joined #ceph
[15:43] * Neowam (~Neowam@195.7.145.213) has joined #ceph
[15:44] * gardensh_ (~gardenshe@90.216.134.198) has joined #ceph
[15:45] * gardenshed (~gardenshe@90.216.134.194) Quit (Ping timeout: 480 seconds)
[15:45] * DV_ (~veillard@2001:41d0:1:d478::1) has joined #ceph
[15:46] <Be-El> ganders: the new osds are not installed in a way that allows the system to start them on reboot. you either have to do it manually, or change the layout of the disk to contain a gpt partition table with a partition of the right guid type
[15:46] * lucas1 (~Thunderbi@218.76.52.64) Quit ()
[15:46] <ganders> Be-El: but if i started manually, they also add to the existing 'bucket', not to the new one
[15:47] <Be-El> ganders: and to prevent the osds from being placed in the wrong location in the crush tree, you have either have to overwrite the crush location in /etc/ceph/ceph.conf for the osds, disable automatic location update and set it manually, or provide a location update script that recognizes which osd belongs to which bucket
[15:48] * DV__ (~veillard@2001:41d0:1:d478::1) has joined #ceph
[15:49] * cok (~chk@nat-cph1-sys.net.one.com) has left #ceph
[15:50] * bene (~ben@nat-pool-bos-t.redhat.com) has joined #ceph
[15:51] * kefu (~kefu@114.86.210.96) Quit (Max SendQ exceeded)
[15:52] * pvh_sa (~pvh@41.164.8.114) has joined #ceph
[15:53] * kefu (~kefu@114.86.210.96) has joined #ceph
[15:53] * DV_ (~veillard@2001:41d0:1:d478::1) Quit (Ping timeout: 480 seconds)
[15:55] <ganders> Be-El: understand what you said... also is possible to mantained the ssd disks for cache-pool on the same bucket list the rest of the osd daemons?
[15:55] <Be-El> ganders: no, since the pools have no idea what a bucket is
[15:55] <ganders> got it
[15:56] <Be-El> ganders: pool have an associated crush ruleset that defines how data is distributed
[15:56] <Be-El> ganders: for a ssd-cache pool you need a corresponding crush ruleset
[15:56] <ganders> yeah, and already defined that
[15:56] <ganders> but the problem is when start the daemon only
[15:57] <ganders> on the ceph.conf file I've defined a [osd.36] host=cephosd04 devs=/dev/sde
[15:57] <Be-El> the problem is the fact that the osd daemon update their crush entry upon booting
[15:57] * yghannam (~yghannam@0001f8aa.user.oftc.net) has joined #ceph
[15:57] * logan (~a@63.143.49.103) Quit (Ping timeout: 480 seconds)
[15:57] <Be-El> ganders: http://ceph.com/docs/master/rados/operations/crush-map/ see the paragraph "CRUSH location"
[15:58] * treenerd (~treenerd@85.193.140.98) Quit (Ping timeout: 480 seconds)
[16:00] * Nacer (~Nacer@252-87-190-213.intermediasud.com) has joined #ceph
[16:02] * jrankin (~jrankin@d53-64-170-236.nap.wideopenwest.com) has joined #ceph
[16:04] * T1w (~jens@node3.survey-it.dk) Quit (Ping timeout: 480 seconds)
[16:06] * treenerd (~treenerd@85.193.140.98) has joined #ceph
[16:07] * MentalRay (~MRay@MTRLPQ42-1176054809.sdsl.bell.ca) has joined #ceph
[16:08] * kefu (~kefu@114.86.210.96) Quit (Max SendQ exceeded)
[16:08] * kefu (~kefu@114.86.210.96) has joined #ceph
[16:09] * ganders (~root@190.2.42.21) Quit (Quit: WeeChat 0.4.2)
[16:09] * kanagaraj (~kanagaraj@121.244.87.117) Quit (Quit: Leaving)
[16:09] * ganders (~root@190.2.42.21) has joined #ceph
[16:09] * MentalRay (~MRay@MTRLPQ42-1176054809.sdsl.bell.ca) Quit ()
[16:09] <ganders> and the crush that i send you before was right?
[16:10] * Rens2Sea (~smf68@7R2AABAMJ.tor-irc.dnsbl.oftc.net) Quit ()
[16:10] * loft (~Nephyrin@46.183.218.141) has joined #ceph
[16:10] * lxo (~aoliva@lxo.user.oftc.net) Quit (Quit: later)
[16:11] * kefu (~kefu@114.86.210.96) Quit (Max SendQ exceeded)
[16:11] * kefu (~kefu@114.86.210.96) has joined #ceph
[16:13] <ganders> http://pastebin.com/raw.php?i=WsfX7qL9
[16:13] <ganders> osd.36,37 and 38 are the cache ssd disks
[16:13] * branto (~branto@ip-213-220-214-203.net.upcbroadband.cz) Quit (Ping timeout: 480 seconds)
[16:15] * lxo (~aoliva@lxo.user.oftc.net) has joined #ceph
[16:18] * bkopilov (~bkopilov@bzq-79-179-39-86.red.bezeqint.net) has joined #ceph
[16:19] * tserong (~tserong@203-214-92-220.dyn.iinet.net.au) has joined #ceph
[16:19] * wushudoin (~wushudoin@38.140.108.2) has joined #ceph
[16:20] * Neowam (~Neowam@195.7.145.213) Quit (Remote host closed the connection)
[16:21] * gaveen (~gaveen@175.157.57.186) Quit (Remote host closed the connection)
[16:21] * pvh_sa (~pvh@41.164.8.114) Quit (Ping timeout: 480 seconds)
[16:23] * branto (~branto@ip-213-220-214-203.net.upcbroadband.cz) has joined #ceph
[16:24] * scuttle|afk is now known as scuttlemonkey
[16:24] * scotp (~scotp@199.83.29.219) has joined #ceph
[16:25] * gregmark (~Adium@68.87.42.115) has joined #ceph
[16:27] * flisky (~Thunderbi@101.254.26.16) has joined #ceph
[16:27] * tserong (~tserong@203-214-92-220.dyn.iinet.net.au) Quit (Ping timeout: 480 seconds)
[16:30] * wushudoin (~wushudoin@38.140.108.2) Quit (Quit: Leaving)
[16:32] * Mika_c (~Mk@122.146.93.152) Quit (Quit: Konversation terminated!)
[16:33] * kefu (~kefu@114.86.210.96) Quit (Max SendQ exceeded)
[16:33] * kefu (~kefu@114.86.210.96) has joined #ceph
[16:37] * flisky (~Thunderbi@101.254.26.16) Quit (Ping timeout: 480 seconds)
[16:38] * flisky (~Thunderbi@123.150.208.157) has joined #ceph
[16:38] * tserong (~tserong@203-214-92-220.dyn.iinet.net.au) has joined #ceph
[16:40] * loft (~Nephyrin@5NZAACRZ2.tor-irc.dnsbl.oftc.net) Quit ()
[16:40] * daniel2_ (~dshafer@0001b605.user.oftc.net) has joined #ceph
[16:40] * yanzheng (~zhyan@125.71.106.160) Quit (Quit: This computer has gone to sleep)
[16:41] * vata (~vata@207.96.182.162) has joined #ceph
[16:41] * Concubidated (~Adium@c-98-232-31-52.hsd1.wa.comcast.net) has joined #ceph
[16:43] <ganders> hi guys, having some issues in another ceph cluster: http://pastebin.com/raw.php?i=F0iCdgqf
[16:43] <ganders> suddently almost all the volumes go into a read-only state (cinder)
[16:44] <ganders> issue a ceph health detail shows: http://pastebin.com/raw.php?i=F0iCdgqf
[16:44] * championofcyrodi (~championo@50-205-35-98-static.hfc.comcastbusiness.net) has left #ceph
[16:45] * rdas (~rdas@121.244.87.116) Quit (Quit: Leaving)
[16:46] * yanzheng (~zhyan@125.71.106.160) has joined #ceph
[16:48] * wushudoin (~wushudoin@38.140.108.2) has joined #ceph
[16:49] * pdrakewe_ (~pdrakeweb@cpe-65-185-74-239.neo.res.rr.com) has joined #ceph
[16:50] * raw is now known as raw_
[16:51] * cloud_vision (~cloud_vis@bzq-79-178-131-156.red.bezeqint.net) has joined #ceph
[16:51] * cloud_vision (~cloud_vis@bzq-79-178-131-156.red.bezeqint.net) Quit ()
[16:51] * Concubidated (~Adium@c-98-232-31-52.hsd1.wa.comcast.net) Quit (Quit: Leaving.)
[16:52] * ircolle (~ircolle@c-71-229-136-109.hsd1.co.comcast.net) has joined #ceph
[16:53] * yanzheng (~zhyan@125.71.106.160) Quit (Quit: This computer has gone to sleep)
[16:53] * ircolle1 (~ircolle@c-71-229-136-109.hsd1.co.comcast.net) has joined #ceph
[16:53] * ircolle (~ircolle@c-71-229-136-109.hsd1.co.comcast.net) Quit ()
[16:54] * pdrakeweb (~pdrakeweb@cpe-65-185-74-239.neo.res.rr.com) Quit (Ping timeout: 480 seconds)
[16:56] * Nacer (~Nacer@252-87-190-213.intermediasud.com) Quit (Remote host closed the connection)
[16:57] * wushudoin_ (~wushudoin@209.132.181.86) has joined #ceph
[16:58] * kefu (~kefu@114.86.210.96) Quit (Max SendQ exceeded)
[16:59] * scotp (~scotp@199.83.29.219) Quit ()
[16:59] * kefu (~kefu@114.86.210.96) has joined #ceph
[16:59] * flisky (~Thunderbi@123.150.208.157) Quit (Quit: flisky)
[17:00] <ganders> I've run a ceph health detail and some osd daemons have been lost
[17:00] <ganders> so the "last acting [xx,xx]" where in fact those osds...
[17:01] <ganders> and now the cluster has several stuck, stale unclean pgs
[17:01] <ganders> is there any way to 'move' those pgs to other osd daemons that are actually running?
[17:01] * dopesong_ (~dopesong@88-119-94-55.static.zebra.lt) has joined #ceph
[17:02] <ganders> http://pastebin.com/raw.php?i=f0JdsyWJ
[17:02] <smerz> that should happen automatically if the data is present. sounds like ceph does not have a copy of the data else where. is that possible ?
[17:02] * gardenshed (~gardenshe@90.216.134.194) has joined #ceph
[17:02] * dopesong_ (~dopesong@88-119-94-55.static.zebra.lt) Quit (Remote host closed the connection)
[17:02] * pdrakeweb (~pdrakeweb@cpe-65-185-74-239.neo.res.rr.com) has joined #ceph
[17:04] * haomaiwang (~haomaiwan@114.111.166.250) has joined #ceph
[17:04] * analbeard (~shw@support.memset.com) has left #ceph
[17:05] <ganders> smerz: yeah could be possible
[17:05] * wushudoin (~wushudoin@38.140.108.2) Quit (Ping timeout: 480 seconds)
[17:05] * yanzheng (~zhyan@125.71.106.160) has joined #ceph
[17:05] <ganders> the thing is that the osds 36,37 and 38 are not present in the cluster
[17:05] <ganders> so the pgs are stuck there
[17:05] * Nacer (~Nacer@252-87-190-213.intermediasud.com) has joined #ceph
[17:05] * kawa2014 (~kawa@87.253.116.96) Quit (Quit: Leaving)
[17:06] <ganders> ive try also the ceph osd lost xx, and since the osd is not there nothing much will od
[17:06] <ganders> will do
[17:06] * wushudoin_ (~wushudoin@209.132.181.86) Quit (Ping timeout: 480 seconds)
[17:06] <ganders> is there any way to get rid of this condition?
[17:06] <smerz> what's the output of "ceph osd tree"
[17:07] * pdrakewe_ (~pdrakeweb@cpe-65-185-74-239.neo.res.rr.com) Quit (Ping timeout: 480 seconds)
[17:07] * m0zes thinks you can do a *very* destructive: ceph pg force_create_pg <pgid>
[17:07] <m0zes> if the data is gone and isn't ever coming back.
[17:07] <ganders> smerz: http://pastebin.com/raw.php?i=0JdD5FLD
[17:08] <ganders> all osds are up and running except 36,37 and 38
[17:08] * pdrakewe_ (~pdrakeweb@cpe-65-185-74-239.neo.res.rr.com) has joined #ceph
[17:08] * dopesong (~dopesong@lb1.mailer.data.lt) Quit (Ping timeout: 480 seconds)
[17:09] * gardensh_ (~gardenshe@90.216.134.198) Quit (Ping timeout: 480 seconds)
[17:09] <ganders> m0zes: you mean running that command and all the pgs that are affected? 7.0, 7.1, 7.2,...7.7 ?
[17:09] <m0zes> ganders: yes
[17:10] <m0zes> but again, very destructive, use only if you don't care about the recovery of the data in those pgs eventually.
[17:10] * angdraug (~angdraug@12.164.168.117) has joined #ceph
[17:10] <ganders> if there's any other way to recover the healt state?
[17:11] <m0zes> I wouldn't do it with pg 7.5
[17:11] * pdrakeweb (~pdrakeweb@cpe-65-185-74-239.neo.res.rr.com) Quit (Ping timeout: 480 seconds)
[17:12] <smerz> if it's possible at all, get those osd's back online. they have data which was not replicated else where (something one can enforce using the crush map).
[17:12] <smerz> but they don't show in the osd map, so i dunno really :|
[17:12] <m0zes> no idea, if the osds are gone, the data that was on them is gone. it seems that those osd had data on them that wasn't replicated somewhere else.
[17:12] <ganders> ok here's the result now after that: http://pastebin.com/raw.php?i=8Wbf6RFj
[17:13] <ganders> http://pastebin.com/raw.php?i=Qp5y3VsP
[17:14] <smerz> it should recover i guess. but you definitely lost some data
[17:14] * luckz (~cryptk@89.105.194.86) has joined #ceph
[17:14] * jclm (~jclm@ip24-253-45-236.lv.lv.cox.net) has joined #ceph
[17:15] * kefu is now known as kefu|afk
[17:15] * wushudoin_ (~wushudoin@38.140.108.2) has joined #ceph
[17:15] <ganders> any idea how to get those "stuck inactive since forever" pgs out of the clus?
[17:16] <smerz> it's recovering right now isn't it ?
[17:17] <ganders> we have: 8 creating,3196 active+clean and 4 active+clean+scrubbing+deep
[17:17] <ganders> HEALTH_WARM 8 pgs stuck inactive; 8 pgs stuck unclean
[17:17] <ganders> hope that is recovering :S
[17:18] <ganders> if not, do i need to mark the pgs from the ceph health detail like "ceph pg 7.0 mark_unfound_lost revert" ?
[17:18] <ganders> or if i leave it right now "recovering" is going to recover sooner or later
[17:21] * Sysadmin88 (~IceChat77@054527d3.skybroadband.com) has joined #ceph
[17:21] <smerz> different questions, do you have any blocked requests right now?
[17:23] * kefu|afk is now known as kefu
[17:26] * b0e (~aledermue@213.95.25.82) Quit (Quit: Leaving.)
[17:26] * shaileshd (~shaileshd@vpngac.ccur.com) has joined #ceph
[17:26] <ganders> smerz: from the output i didnt notice any block request, is there any special command for that?
[17:27] <smerz> any request taking longer than 30 seconds will show in ceph health (you can set the treshold lower)
[17:28] <smerz> i'm not sure. there are some pg commands but i'm not the right guy to talk about that. haven't needed to touch that :|
[17:30] * joshd (~jdurgin@68-119-140-18.dhcp.ahvl.nc.charter.com) has joined #ceph
[17:32] <ganders> the ceph health cmd just notice the HEALTH_WARN 8 pgs stuck inactive; 8 pgs stuck unclean
[17:33] <ganders> I don't know if the "8 pgs stuck inactive" can be remove in any way or not?
[17:34] * debian112 (~bcolbert@24.126.201.64) has joined #ceph
[17:35] <smerz> there probably are ways. i hope someone else can point out how
[17:35] * zaitcev (~zaitcev@2001:558:6001:10:61d7:f51f:def8:4b0f) has joined #ceph
[17:37] <ganders> it will really be helpful
[17:37] * haomaiwang (~haomaiwan@114.111.166.250) Quit (Read error: Connection reset by peer)
[17:37] * haomaiwang (~haomaiwan@114.111.166.250) has joined #ceph
[17:38] * DV__ (~veillard@2001:41d0:1:d478::1) Quit (Ping timeout: 480 seconds)
[17:40] * TMM (~hp@sams-office-nat.tomtomgroup.com) Quit (Quit: Ex-Chat)
[17:40] <ganders> got it
[17:41] * tserong (~tserong@203-214-92-220.dyn.iinet.net.au) Quit (Ping timeout: 480 seconds)
[17:41] * treenerd (~treenerd@85.193.140.98) Quit (Ping timeout: 480 seconds)
[17:43] * bandrus (~brian@198.8.80.53) has joined #ceph
[17:43] <smerz> for our educational value how did you force the creation ?
[17:44] * JV (~chatzilla@204.14.239.53) has joined #ceph
[17:44] * luckz (~cryptk@2WVAACMHI.tor-irc.dnsbl.oftc.net) Quit ()
[17:45] * KeeperOfTheSoul (~Mraedis@nx-01.tor-exit.network) has joined #ceph
[17:45] * tserong (~tserong@203-214-92-220.dyn.iinet.net.au) has joined #ceph
[17:45] * pdrakewe_ (~pdrakeweb@cpe-65-185-74-239.neo.res.rr.com) Quit (Read error: Connection reset by peer)
[17:46] * pdrakeweb (~pdrakeweb@cpe-65-185-74-239.neo.res.rr.com) has joined #ceph
[17:46] * DV__ (~veillard@2001:41d0:a:f29f::1) has joined #ceph
[17:47] <ganders> smerz: basically there was a pool that was not used... but for some reason it has some pgs inside, the ones that mentioned before
[17:47] <ganders> so i check that the pool is was not actually being used, and then remove the pool
[17:47] <smerz> i had such a suspicion. no blocked IO against stale PG's
[17:47] * pdrakeweb (~pdrakeweb@cpe-65-185-74-239.neo.res.rr.com) Quit (Read error: Connection reset by peer)
[17:47] <smerz> well but that means you didn't loose data either or ?
[17:48] <smerz> (or is that perhaps too optimistic)
[17:48] * pdrakeweb (~pdrakeweb@cpe-65-185-74-239.neo.res.rr.com) has joined #ceph
[17:48] <ganders> that's it.. then the pgs that were unstable and stuck left the cluster
[17:48] * joshd (~jdurgin@68-119-140-18.dhcp.ahvl.nc.charter.com) Quit (Quit: Leaving.)
[17:48] <smerz> well i'
[17:48] * fireD (~fireD@93-139-170-53.adsl.net.t-com.hr) has joined #ceph
[17:48] <smerz> argh. I'm sure you're releaved about that
[17:50] * calvinx (~calvin@101.100.172.246) Quit (Quit: calvinx)
[17:51] <ganders> it was a really rare condition
[17:51] <ganders> also all of our vols get read-only...
[17:51] * pdrakeweb (~pdrakeweb@cpe-65-185-74-239.neo.res.rr.com) Quit (Read error: No route to host)
[17:51] * pdrakeweb (~pdrakeweb@cpe-65-185-74-239.neo.res.rr.com) has joined #ceph
[17:51] * dopesong (~dopesong@78-60-74-130.static.zebra.lt) has joined #ceph
[17:52] * midnightrunner (~midnightr@c-67-174-241-112.hsd1.ca.comcast.net) has joined #ceph
[17:53] * LeaChim (~LeaChim@host86-163-124-72.range86-163.btcentralplus.com) has joined #ceph
[17:53] * kefu is now known as kefu|afk
[17:53] * midnightrunner (~midnightr@c-67-174-241-112.hsd1.ca.comcast.net) Quit (Read error: Connection reset by peer)
[17:54] * midnightrunner (~midnightr@c-67-174-241-112.hsd1.ca.comcast.net) has joined #ceph
[17:55] * cholcombe (~chris@c-73-180-29-35.hsd1.or.comcast.net) has joined #ceph
[17:55] * Concubidated (~Adium@66.87.139.126) has joined #ceph
[17:58] * midnight_ (~midnightr@216.113.160.71) has joined #ceph
[18:02] * linjan (~linjan@195.110.41.9) Quit (Ping timeout: 480 seconds)
[18:02] * davidz (~davidz@cpe-23-242-189-171.socal.res.rr.com) has joined #ceph
[18:02] * midnightrunner (~midnightr@c-67-174-241-112.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[18:04] * wenjunhuang__ (~wenjunhua@61.135.172.68) has joined #ceph
[18:05] * sigurdga (~sigurdga@ida.it.ntnu.no) Quit (Remote host closed the connection)
[18:09] * Nacer (~Nacer@252-87-190-213.intermediasud.com) Quit (Ping timeout: 480 seconds)
[18:10] * nsoffer (~nsoffer@nat-pool-tlv-t.redhat.com) Quit (Ping timeout: 480 seconds)
[18:11] * championofcyrodi (~championo@50-205-35-98-static.hfc.comcastbusiness.net) has joined #ceph
[18:11] * wenjunhuang_ (~wenjunhua@61.135.172.68) Quit (Ping timeout: 480 seconds)
[18:12] * alram (~alram@206.169.83.146) has joined #ceph
[18:13] * gardensh_ (~gardenshe@90.216.134.198) has joined #ceph
[18:14] * KeeperOfTheSoul (~Mraedis@0SGAAA0Q2.tor-irc.dnsbl.oftc.net) Quit ()
[18:14] * dug (~WedTM@37.187.129.166) has joined #ceph
[18:15] * xdeller (~xdeller@h195-91-128-218.ln.rinet.ru) Quit (Read error: No route to host)
[18:16] * JV_ (~chatzilla@204.14.239.105) has joined #ceph
[18:17] * kawa2014 (~kawa@94.161.189.137) has joined #ceph
[18:17] * gardensh_ (~gardenshe@90.216.134.198) Quit (Remote host closed the connection)
[18:18] * Kioob`Taff (~plug-oliv@2a01:e35:2e8a:1e0::42:10) Quit (Quit: Leaving.)
[18:18] * gardenshed (~gardenshe@90.216.134.194) Quit (Ping timeout: 480 seconds)
[18:22] * JV (~chatzilla@204.14.239.53) Quit (Ping timeout: 480 seconds)
[18:22] * JV_ is now known as JV
[18:23] * gardenshed (~gardenshe@90.216.134.198) has joined #ceph
[18:24] * pdrakewe_ (~pdrakeweb@cpe-65-185-74-239.neo.res.rr.com) has joined #ceph
[18:24] * pdrakeweb (~pdrakeweb@cpe-65-185-74-239.neo.res.rr.com) Quit (Read error: Connection reset by peer)
[18:25] * shaunm (~shaunm@74.215.76.114) Quit (Ping timeout: 480 seconds)
[18:26] * dgbaley27 (~matt@c-67-176-93-83.hsd1.co.comcast.net) has joined #ceph
[18:26] * jcsp (~Adium@82-71-16-249.dsl.in-addr.zen.co.uk) has joined #ceph
[18:28] * Concubidated (~Adium@66.87.139.126) Quit (Quit: Leaving.)
[18:29] * nsoffer (~nsoffer@nat-pool-tlv-t.redhat.com) has joined #ceph
[18:30] * jwilkins (~jwilkins@2601:9:4580:f4c:ea2a:eaff:fe08:3f1d) has joined #ceph
[18:31] * jcsp1 (~Adium@82-71-16-249.dsl.in-addr.zen.co.uk) Quit (Ping timeout: 480 seconds)
[18:34] * haomaiwang (~haomaiwan@114.111.166.250) Quit (Ping timeout: 480 seconds)
[18:34] * harold (~hamiller@71-94-227-123.dhcp.mdfd.or.charter.com) Quit (Quit: Leaving)
[18:35] * yanzheng (~zhyan@125.71.106.160) Quit (Quit: This computer has gone to sleep)
[18:37] * Be-El (~quassel@fb08-bcf-pc01.computational.bio.uni-giessen.de) Quit (Remote host closed the connection)
[18:38] * gardenshed (~gardenshe@90.216.134.198) Quit (Ping timeout: 480 seconds)
[18:39] * sleinen (~Adium@2001:620:0:82::10f) has joined #ceph
[18:42] * haomaiwang (~haomaiwan@114.111.166.250) has joined #ceph
[18:43] * mgolub (~Mikolaj@91.225.203.13) has joined #ceph
[18:44] * joshd (~jdurgin@206.169.83.146) has joined #ceph
[18:44] * dug (~WedTM@7R2AABATL.tor-irc.dnsbl.oftc.net) Quit ()
[18:44] * mog_ (~Cue@onions.mit.edu) has joined #ceph
[18:46] * sleinen1 (~Adium@2001:620:0:2d:7ed1:c3ff:fedc:3223) Quit (Ping timeout: 480 seconds)
[18:46] * pvh_sa (~pvh@105.210.174.225) has joined #ceph
[18:47] * daniel2_ (~dshafer@0001b605.user.oftc.net) Quit (Ping timeout: 480 seconds)
[18:48] * kawa2014 (~kawa@94.161.189.137) Quit (Quit: Leaving)
[18:49] * fireD_ (~fireD@78-1-238-117.adsl.net.t-com.hr) has joined #ceph
[18:51] * TMM (~hp@178-84-46-106.dynamic.upc.nl) has joined #ceph
[18:55] * fireD (~fireD@93-139-170-53.adsl.net.t-com.hr) Quit (Ping timeout: 480 seconds)
[18:58] * rotbeard (~redbeard@x5f7528eb.dyn.telefonica.de) Quit (Quit: Leaving)
[19:04] * bene2 (~ben@nat-pool-bos-t.redhat.com) has joined #ceph
[19:07] * jordanP (~jordan@213.215.2.194) Quit (Quit: Leaving)
[19:08] * bene (~ben@nat-pool-bos-t.redhat.com) Quit (Ping timeout: 480 seconds)
[19:08] * midnight_ (~midnightr@216.113.160.71) Quit ()
[19:09] * fridim_ (~fridim@56-198-190-109.dsl.ovh.fr) Quit (Ping timeout: 480 seconds)
[19:10] * evilrob00 (~evilrob00@cpe-72-179-3-209.austin.res.rr.com) has joined #ceph
[19:10] * lovejoy (~lovejoy@213.83.69.6) has joined #ceph
[19:10] * lovejoy (~lovejoy@213.83.69.6) Quit ()
[19:12] * sleinen (~Adium@2001:620:0:82::10f) Quit (Ping timeout: 480 seconds)
[19:14] * mog_ (~Cue@7R2AABAU0.tor-irc.dnsbl.oftc.net) Quit ()
[19:14] * raw_ (~raw@5.79.71.195) Quit (Remote host closed the connection)
[19:16] * pvh_sa (~pvh@105.210.174.225) Quit (Ping timeout: 480 seconds)
[19:17] * jschmid (~jxs@nl11x.mullvad.net) has joined #ceph
[19:21] <zaitcev> How do I list all known RGW users?
[19:21] <zaitcev> The radosgw-admin user info only works if --uid=foo is supplied.
[19:22] <zaitcev> I looked at http://docs.ceph.com/docs/master/radosgw/admin/ and the radosgw-admin(8), but perhaps I'm missing a vital hint somewhere.
[19:23] * daniel2_ (~dshafer@0001b605.user.oftc.net) has joined #ceph
[19:27] <theanalyst> zaitcev: are the users created from radosgw-admin only?
[19:27] <zaitcev> theanalyst: yes
[19:27] <alram> zaitcev: radosgw-admin metadata list user
[19:28] * puffy (~puffy@c-50-131-179-74.hsd1.ca.comcast.net) has joined #ceph
[19:28] <theanalyst> :)
[19:28] * kefu|afk (~kefu@114.86.210.96) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[19:28] <zaitcev> alram: thanks, that worked, albeit in JSON
[19:29] <theanalyst> also probably listing the objects in .rgw.users or something should list the user ids only (though it wont be as accurate as rgw-admin command)
[19:31] * debian112 (~bcolbert@24.126.201.64) Quit (Read error: Connection reset by peer)
[19:31] * sleinen (~Adium@84-72-160-233.dclient.hispeed.ch) has joined #ceph
[19:33] * sleinen1 (~Adium@2001:620:0:82::100) has joined #ceph
[19:34] * debian112 (~bcolbert@24.126.201.64) has joined #ceph
[19:34] * midnightrunner (~midnightr@c-67-174-241-112.hsd1.ca.comcast.net) has joined #ceph
[19:35] * shylesh (~shylesh@1.22.48.43) has joined #ceph
[19:35] * fridim_ (~fridim@56-198-190-109.dsl.ovh.fr) has joined #ceph
[19:39] * sleinen (~Adium@84-72-160-233.dclient.hispeed.ch) Quit (Ping timeout: 480 seconds)
[19:40] * midnight_ (~midnightr@216.113.160.71) has joined #ceph
[19:41] * jbautista- (~wushudoin@209.132.181.86) has joined #ceph
[19:42] * nsoffer (~nsoffer@nat-pool-tlv-t.redhat.com) Quit (Ping timeout: 480 seconds)
[19:42] * bitserker (~toni@63.pool85-52-240.static.orange.es) Quit (Ping timeout: 480 seconds)
[19:42] * pdrakeweb (~pdrakeweb@cpe-65-185-74-239.neo.res.rr.com) has joined #ceph
[19:44] * richardus1 (~TheDoudou@chulak.enn.lu) has joined #ceph
[19:46] * midnightrunner (~midnightr@c-67-174-241-112.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[19:46] * cloudm2 (uid37542@id-37542.highgate.irccloud.com) has joined #ceph
[19:46] * jschmid (~jxs@nl11x.mullvad.net) Quit (Ping timeout: 480 seconds)
[19:48] * pdrakewe_ (~pdrakeweb@cpe-65-185-74-239.neo.res.rr.com) Quit (Ping timeout: 480 seconds)
[19:48] * wushudoin_ (~wushudoin@38.140.108.2) Quit (Ping timeout: 480 seconds)
[19:49] * jbautista- (~wushudoin@209.132.181.86) Quit (Ping timeout: 480 seconds)
[19:52] * haomaiwa_ (~haomaiwan@114.111.166.250) has joined #ceph
[19:53] * linjan (~linjan@80.179.241.26) has joined #ceph
[19:55] * haomaiwang (~haomaiwan@114.111.166.250) Quit (Ping timeout: 480 seconds)
[19:57] * flakrat (~flakrat@fttu-216-41-245-200.btes.tv) has joined #ceph
[19:57] * flakrat_ (~flakrat@fttu-216-41-245-200.btes.tv) has joined #ceph
[19:59] * flakrat__ (~oftc-webi@fttu-216-41-245-200.btes.tv) has joined #ceph
[19:59] * jschmid (~jxs@ip9234f579.dynamic.kabel-deutschland.de) has joined #ceph
[19:59] * flakrat__ (~oftc-webi@fttu-216-41-245-200.btes.tv) has left #ceph
[19:59] * jbautista- (~wushudoin@38.140.108.2) has joined #ceph
[20:00] * wenjunhuang__ (~wenjunhua@61.135.172.68) Quit (Remote host closed the connection)
[20:00] * wenjunhuang__ (~wenjunhua@61.135.172.68) has joined #ceph
[20:01] <flakrat_> What is the latest recommended release for production use? Hammer (0.94.1) or Firefly (0.80.9)? Thanks
[20:01] * arcimboldo (~antonio@130.60.144.162) Quit (Ping timeout: 480 seconds)
[20:01] * derjohn_mob (~aj@fw.gkh-setu.de) Quit (Ping timeout: 480 seconds)
[20:02] * flakrat_ (~flakrat@fttu-216-41-245-200.btes.tv) has left #ceph
[20:02] <flakrat> For RBD use, no CephFS
[20:04] <loicd> daviddcc: I'm not sure it's possible to scrub a single PG on a given OSD. I think not.
[20:04] * gardenshed (~gardenshe@176.27.51.101) has joined #ceph
[20:05] <daviddcc> loicd,
[20:05] <daviddcc> sample : A1 ceph # ceph pg deep-scrub 44.fd3
[20:05] <daviddcc> instructing pg 44.fd3 on osd.3 to deep-scrub
[20:06] <loicd> daviddcc: so that works ?
[20:06] <loicd> ah right, nice
[20:06] <daviddcc> flakrat, i think Hammer, but i not sure
[20:07] <daviddcc> loicd, 2015-05-26 20:07:08.683731 mon.0 [INF] from='client.? 192.168.4.1:0/1008628' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "44.fd3"}]: dispatch
[20:07] <loicd> http://workbench.dachary.org/ceph/ceph/blob/hammer/src/mon/MonCommands.h#L156
[20:08] <loicd> giant as well
[20:08] <loicd> http://workbench.dachary.org/ceph/ceph/blob/giant/src/mon/MonCommands.h#L134
[20:08] <daviddcc> but only 2 deep-scrub in same time
[20:08] <loicd> firefly also http://workbench.dachary.org/ceph/ceph/blob/firefly/src/mon/MonCommands.h#L134
[20:09] <loicd> emperor also http://workbench.dachary.org/ceph/ceph/blob/emperor/src/mon/MonCommands.h#L131
[20:09] * zack_dolby (~textual@pa3b3a1.tokynt01.ap.so-net.ne.jp) has joined #ceph
[20:09] * loicd yawns :-)
[20:10] * vbellur (~vijay@122.172.17.214) Quit (Ping timeout: 480 seconds)
[20:12] * daniel2_ (~dshafer@0001b605.user.oftc.net) Quit (Remote host closed the connection)
[20:14] * slowriot (~KapiteinK@chulak.enn.lu) has joined #ceph
[20:14] * richardus1 (~TheDoudou@7R2AABAXK.tor-irc.dnsbl.oftc.net) Quit ()
[20:21] <daviddcc> it's very strange
[20:21] <daviddcc> After crash and reboot :
[20:21] <daviddcc> [ 1945.292802] libceph: mon0 192.168.4.1:6789 socket error on read
[20:21] <daviddcc> [ 1953.204281] libceph: mon0 192.168.4.1:6789 feature set mismatch, my 2b84a042a42 < server's 102b84a042a42, missing 1000000000000
[20:22] <daviddcc> What is flag bit 1000000000000 ?
[20:22] * eoin (~eoin@89-93-153-201.hfc.dyn.abo.bbox.fr) has joined #ceph
[20:22] <daviddcc> #define CEPH_FEATURE_OSDREPLYMUX (1ULL<<12)
[20:23] * linjan (~linjan@80.179.241.26) Quit (Ping timeout: 480 seconds)
[20:23] * pvh_sa (~pvh@105.210.174.225) has joined #ceph
[20:26] <daviddcc> ok
[20:26] <daviddcc> CEPH_FEATURE_CRUSH_V4 ****
[20:28] * fireD_ (~fireD@78-1-238-117.adsl.net.t-com.hr) Quit (Quit: Lost terminal)
[20:30] * gardenshed (~gardenshe@176.27.51.101) Quit (Remote host closed the connection)
[20:30] * gardenshed (~gardenshe@90.216.134.194) has joined #ceph
[20:30] * shaunm (~shaunm@74.215.76.114) has joined #ceph
[20:31] * linjan (~linjan@213.8.240.146) has joined #ceph
[20:33] * flakrat (~flakrat@fttu-216-41-245-200.btes.tv) Quit (Quit: This computer has gone to sleep)
[20:34] <daviddcc> http://www.spinics.net/lists/ceph-users/msg17411.html
[20:35] * jrankin (~jrankin@d53-64-170-236.nap.wideopenwest.com) Quit (Quit: Leaving)
[20:42] * shylesh (~shylesh@1.22.48.43) Quit (Remote host closed the connection)
[20:44] * slowriot (~KapiteinK@7R2AABAYP.tor-irc.dnsbl.oftc.net) Quit ()
[20:44] <m0zes> daviddcc: that particular bug was fixed in 0.94.1
[20:45] * rotbeard (~redbeard@2a02:908:df10:d300:76f0:6dff:fe3b:994d) has joined #ceph
[20:45] * m0zes was at the site that discovered it.
[20:45] <daviddcc> Hmmm
[20:45] <daviddcc> A1 tmp # ceph --version
[20:45] <daviddcc> ceph version 0.94.1-111-gb69fb89 (b69fb89122d6f989152a29124cc7ed54b5e4d43b)
[20:45] * gardenshed (~gardenshe@90.216.134.194) Quit (Ping timeout: 480 seconds)
[20:46] <m0zes> you have straw2 buckets?
[20:46] * adeel (~adeel@fw1.ridgeway.scc-zip.net) Quit (Quit: Leaving...)
[20:47] * logan (~a@63.143.49.103) has joined #ceph
[20:48] <daviddcc> tunable straw_calc_version 1
[20:49] <m0zes> right, but that is the calc version, ceph osd crush dump | grep alg
[20:50] * analbeard (~shw@support.memset.com) has joined #ceph
[20:51] * Blaine_HP (~oftc-webi@ztxe01cs304.austin.hp.com) has joined #ceph
[20:51] <daviddcc> ok
[20:52] <daviddcc> I do not know why but I have a mix straw/straw2 in the crush
[20:53] <m0zes> did you, perhaps, run 'ceph osd crush tunables optimal' or 'ceph osd crush tunables hammer'?
[20:53] * Blaine_HP (~oftc-webi@ztxe01cs304.austin.hp.com) Quit ()
[20:55] * ircolle1 is now known as ircolle-food
[20:56] <daviddcc> yes, that's it. And I made tunables optimal between 2 add bucket
[20:56] <m0zes> if so, that would enable straw2, and any new (and/or modified?) buckets would have been created as straw2
[20:56] <daviddcc> thanks m0zes
[20:57] <m0zes> no problem. iirc, kernel 4.1 is supposed to support straw2 buckets
[20:57] * daviddcc read http://www.spinics.net/lists/ceph-devel/msg21635.html
[20:58] * nils_ (~nils@doomstreet.collins.kg) Quit (Quit: This computer has gone to sleep)
[21:00] * m0zes read https://git.kernel.org/cgit/linux/kernel/git/sage/ceph-client.git/commit/net/ceph?h=for-linus&id=958a27658d94cf212caeb0ffb04ee0b0bc89cc40
[21:00] <daviddcc> :)
[21:00] <m0zes> lots of magic hex :D
[21:01] <daviddcc> http://img0.gtsstatic.com/wallpapers/42aac4bcf7aad24ef1cb0a1cb9f2940d_large.jpeg
[21:01] <daviddcc> :}
[21:02] * zack_dolby (~textual@pa3b3a1.tokynt01.ap.so-net.ne.jp) Quit (Read error: Connection reset by peer)
[21:02] * zack_dolby (~textual@pa3b3a1.tokynt01.ap.so-net.ne.jp) has joined #ceph
[21:04] * terje_ (~root@135.109.216.239) has joined #ceph
[21:05] <daviddcc> A1 tmp # rbd map 0/0
[21:06] * terje (~root@135.109.216.239) Quit (Ping timeout: 480 seconds)
[21:06] <daviddcc> /dev/rbd0
[21:06] <daviddcc> great
[21:06] * evilrob00 (~evilrob00@cpe-72-179-3-209.austin.res.rr.com) Quit (Remote host closed the connection)
[21:07] * nsoffer (~nsoffer@bzq-109-64-255-238.red.bezeqint.net) has joined #ceph
[21:18] * alfredodeza (~alfredode@198.206.133.89) Quit (Quit: ZNC - http://znc.in)
[21:19] * alfredodeza (~alfredode@198.206.133.89) has joined #ceph
[21:25] * ngoswami (~ngoswami@121.244.87.116) Quit (Quit: Leaving)
[21:26] * debian112 (~bcolbert@24.126.201.64) has left #ceph
[21:30] * dopesong (~dopesong@78-60-74-130.static.zebra.lt) Quit (Remote host closed the connection)
[21:34] * fmanana (~fdmanana@bl13-148-61.dsl.telepac.pt) Quit (Ping timeout: 480 seconds)
[21:38] * ircolle-food is now known as ircolle
[21:48] * alram (~alram@206.169.83.146) Quit (Quit: Lost terminal)
[21:48] * alram (~alram@206.169.83.146) has joined #ceph
[21:50] * linuxkidd__ (~linuxkidd@42.sub-70-193-59.myvzw.com) has joined #ceph
[21:53] * Scymex (~zapu@176.10.99.204) has joined #ceph
[21:54] * terje (~root@135.109.216.239) has joined #ceph
[21:56] * terje_ (~root@135.109.216.239) Quit (Ping timeout: 480 seconds)
[21:57] * sjm (~sjm@pool-173-70-76-86.nwrknj.fios.verizon.net) has left #ceph
[21:57] * linuxkidd__ (~linuxkidd@42.sub-70-193-59.myvzw.com) Quit (Quit: Leaving)
[21:57] * linjan (~linjan@213.8.240.146) Quit (Remote host closed the connection)
[21:58] * BManojlovic (~steki@cable-89-216-192-77.dynamic.sbb.rs) has joined #ceph
[22:01] * shohn (~shohn@dslb-094-223-166-015.094.223.pools.vodafone-ip.de) Quit (Quit: Leaving.)
[22:10] * bandrus1 (~brian@80.sub-70-214-41.myvzw.com) has joined #ceph
[22:14] * bandrus (~brian@198.8.80.53) Quit (Ping timeout: 480 seconds)
[22:18] * jks (~jks@178.155.151.121) Quit (Ping timeout: 480 seconds)
[22:21] * STC_Stephen (~STC_Steph@192.41.52.12) has joined #ceph
[22:23] * Scymex (~zapu@8Q4AAA1M4.tor-irc.dnsbl.oftc.net) Quit ()
[22:23] * offer (~Chrissi_@199.254.238.44) has joined #ceph
[22:24] <cmdrk> what determines how much memory an OSD uses? PGs, disk size, other?
[22:26] * cmdrk discovers tell osd.x heap dump
[22:30] * badone (~brad@CPE-121-215-241-179.static.qld.bigpond.net.au) has joined #ceph
[22:32] * puffy (~puffy@c-50-131-179-74.hsd1.ca.comcast.net) Quit (Quit: Leaving.)
[22:33] * terje_ (~root@135.109.216.239) has joined #ceph
[22:35] * terje (~root@135.109.216.239) Quit (Ping timeout: 480 seconds)
[22:37] * dyasny (~dyasny@173.231.115.58) Quit (Ping timeout: 480 seconds)
[22:38] * avozza (~avozza@83.162.204.36) has joined #ceph
[22:38] * fridim_ (~fridim@56-198-190-109.dsl.ovh.fr) Quit (Ping timeout: 480 seconds)
[22:39] * ganders (~root@190.2.42.21) Quit (Quit: WeeChat 0.4.2)
[22:40] * flakrat (~flakrat@fttu-216-41-245-200.btes.tv) has joined #ceph
[22:40] * mgolub (~Mikolaj@91.225.203.13) Quit (Quit: away)
[22:42] * pvh_sa_ (~pvh@105-236-14-222.access.mtnbusiness.co.za) has joined #ceph
[22:43] * JV (~chatzilla@204.14.239.105) Quit (Ping timeout: 480 seconds)
[22:44] <gregsfortytwo> PG counts and state (if they're degraded, more; likewise more if recovering or backfilling), state of cluster (do they need to cache more OSDMaps than usual); ...maybe other stuff, but mostly that?
[22:44] <daviddcc> cmdrk, 1G/1To disk size
[22:46] * jks (~jks@178.155.151.121) has joined #ceph
[22:47] * alfredodeza (~alfredode@198.206.133.89) Quit (Quit: ZNC - http://znc.in)
[22:47] * alfredodeza (~alfredode@198.206.133.89) has joined #ceph
[22:47] <daviddcc> metadata/oid pearhaps
[22:48] <daviddcc> Nb of objects
[22:49] * pvh_sa (~pvh@105.210.174.225) Quit (Ping timeout: 480 seconds)
[22:52] * jdillaman (~jdillaman@pool-108-18-97-82.washdc.fios.verizon.net) Quit (Quit: jdillaman)
[22:53] * offer (~Chrissi_@7R2AABA3F.tor-irc.dnsbl.oftc.net) Quit ()
[22:53] * rcfighter (~smf68@nx-01.tor-exit.network) has joined #ceph
[22:59] * bitserker (~toni@188.87.126.203) has joined #ceph
[23:01] * fridim_ (~fridim@56-198-190-109.dsl.ovh.fr) has joined #ceph
[23:02] * ChanServ sets mode +o scuttlemonkey
[23:08] * rlrevell (~leer@vbo1.inmotionhosting.com) Quit (Ping timeout: 480 seconds)
[23:10] * STC_Stephen (~STC_Steph@192.41.52.12) Quit ()
[23:10] * nmtadam (~oftc-webi@pat.hitachigst.com) has joined #ceph
[23:11] * owasserm (~owasserm@52D9864F.cm-11-1c.dynamic.ziggo.nl) Quit (Ping timeout: 480 seconds)
[23:13] <nmtadam> Hello, Can someone explaing what happens when an IO error occurs on an object?
[23:14] <nmtadam> We have an experiment where we make a sector of a object bad and have noticed that the OSD is eventually brought down.
[23:17] * jbautista- (~wushudoin@38.140.108.2) Quit (Quit: Leaving)
[23:21] * wicope (~wicope@0001fd8a.user.oftc.net) Quit (Read error: Connection reset by peer)
[23:23] * rcfighter (~smf68@5NZAACSE3.tor-irc.dnsbl.oftc.net) Quit ()
[23:23] * cmrn (~nih@destiny.enn.lu) has joined #ceph
[23:25] * analbeard (~shw@support.memset.com) Quit (Quit: Leaving.)
[23:27] * brad_mssw (~brad@66.129.88.50) Quit (Quit: Leaving)
[23:30] * alfredodeza (~alfredode@198.206.133.89) Quit (Quit: ZNC - http://znc.in)
[23:31] * alfredodeza (~alfredode@198.206.133.89) has joined #ceph
[23:33] * eoin (~eoin@89-93-153-201.hfc.dyn.abo.bbox.fr) Quit (Quit: Leaving)
[23:35] * tupper (~tcole@2001:420:2280:1272:8900:f9b8:3b49:567e) Quit (Ping timeout: 480 seconds)
[23:35] * owasserm (~owasserm@52D9864F.cm-11-1c.dynamic.ziggo.nl) has joined #ceph
[23:42] * wushudoin (~wushudoin@38.140.108.2) has joined #ceph
[23:42] * treenerd (~treenerd@cpe90-146-100-181.liwest.at) has joined #ceph
[23:42] * treenerd (~treenerd@cpe90-146-100-181.liwest.at) Quit ()
[23:44] * nsoffer (~nsoffer@bzq-109-64-255-238.red.bezeqint.net) Quit (Ping timeout: 480 seconds)
[23:49] * primechuck (~primechuc@host-95-2-129.infobunker.com) Quit (Remote host closed the connection)
[23:52] * bene (~ben@nat-pool-bos-t.redhat.com) has joined #ceph
[23:52] * bene (~ben@nat-pool-bos-t.redhat.com) Quit ()
[23:53] * cmrn (~nih@5NZAACSFW.tor-irc.dnsbl.oftc.net) Quit ()
[23:53] * AotC (~Silentspy@spftor1e1.privacyfoundation.ch) has joined #ceph
[23:55] * gregmark (~Adium@68.87.42.115) Quit (Quit: Leaving.)
[23:58] * bene2 (~ben@nat-pool-bos-t.redhat.com) Quit (Ping timeout: 480 seconds)

These logs were automatically created by CephLogBot on irc.oftc.net using the Java IRC LogBot.