#ceph IRC Log

Index

IRC Log for 2016-05-05

Timestamps are in GMT/BST.

[0:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[0:01] * bjornar (~bjornar@109.247.131.38) Quit (Server closed connection)
[0:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[0:01] * bjornar (~bjornar@109.247.131.38) has joined #ceph
[0:05] <badone> Kilty: how many hosts?
[0:05] <Kilty> 4 physical nodes
[0:06] <Kilty> but a mon is running in a lxc container on each physical node
[0:06] <badone> what size do you have for the pool (replicas)
[0:06] * DV (~veillard@2001:41d0:a:f29f::1) Quit (Remote host closed the connection)
[0:06] <Kilty> 3 replicas
[0:06] <Kilty> 3 80gb ssds for the osds
[0:07] <badone> does "ceph osd tree" show one osd under each host and show them up?
[0:07] * DV (~veillard@2001:41d0:a:f29f::1) has joined #ceph
[0:07] <badone> ahh, you said they were up and in
[0:08] <Kilty> yeah they are all up and in
[0:08] <badone> creating normally means your crush mapping for the pool is unsatisfiable
[0:08] <Kilty> and yes ceph osd tree shows each on a new host
[0:09] * TehZomB (~Keiya@hessel3.torservers.net) has joined #ceph
[0:09] <vasu> Kilty: since its a new deployment, might be worth deleting all default pools, verifying ceph.conf and creating pools again
[0:09] <Kilty> badone: the pool settings are set via the bundle in order to provide storage for openstack
[0:09] <badone> Kilty: bundle?
[0:10] <Kilty> badone: not sure if you've worked with juju, but it encapsulates configuration and application deployment into bundles
[0:10] <badone> Kilty: no, I know nothing about juju
[0:11] <Kilty> for sure. It's the recommended way to deploy openstack on Ubuntu
[0:11] <badone> Kilty: understood
[0:11] * brad_mssw (~brad@66.129.88.50) Quit (Quit: Leaving)
[0:12] <badone> Kilty: try taking a look at your crushmap and see if it all looks right.
[0:12] <badone> ceph osd getcrushmap -o filename
[0:13] <badone> crushtool -d filename -o filename.txt
[0:13] * Skaag (~lunix@rrcs-67-52-140-5.west.biz.rr.com) Quit (Quit: Leaving.)
[0:14] <Kilty> badone: does that look reasonable? http://pastebin.com/8UjzMPjA
[0:15] <badone> Kilty: nope, not at all
[0:15] <badone> you have no hosts and n osds
[0:16] <badone> whatever created that cluster did some bad juju :P
[0:16] <Kilty> haha
[0:16] <lurbs> What does 'ceph osd tree' look like?
[0:16] <badone> bbiab
[0:16] <Kilty> lurbs badone: http://pastebin.com/uw8CHys1
[0:16] * shaunm (~shaunm@nat-pool-rdu-u.redhat.com) Quit (Ping timeout: 480 seconds)
[0:17] <Kilty> output of both ceph -s and osd tree
[0:18] <lurbs> Yeah, so your OSDs are just attached to the root of the tree, not to a node. It should be more like:
[0:18] <lurbs> http://pastebin.com/raw/KTtgduph
[0:18] * csoukup (~csoukup@159.140.254.98) Quit (Ping timeout: 480 seconds)
[0:19] <Kilty> interesting
[0:19] <Kilty> is there any way to easily repair that?
[0:19] <Kilty> I want to report a bug to the juju team, but being able to give them a patch to their deployment would make things much quicker
[0:20] * Skaag (~lunix@rrcs-67-52-140-5.west.biz.rr.com) has joined #ceph
[0:23] <lurbs> No idea how it got into that state to begin with, sorry.
[0:24] <Kilty> no worries - at least I have a starting point to start poking! thanks a lot guys
[0:26] * zigo (~quassel@gplhost-3-pt.tunnel.tserv18.fra1.ipv6.he.net) Quit (Server closed connection)
[0:26] * zigo (~quassel@gplhost-3-pt.tunnel.tserv18.fra1.ipv6.he.net) has joined #ceph
[0:28] * squizzi (~squizzi@nat-pool-rdu-t.redhat.com) Quit (Ping timeout: 480 seconds)
[0:29] * theanalyst (theanalyst@open.source.rocks.my.socks.firrre.com) Quit (Ping timeout: 480 seconds)
[0:29] <badone> np Kilty, good luck
[0:30] * khyron (~khyron@fixed-190-159-187-190-159-75.iusacell.net) Quit (Ping timeout: 480 seconds)
[0:30] * reed (~reed@75-101-54-18.dsl.static.fusionbroadband.com) Quit (Quit: Ex-Chat)
[0:38] * TehZomB (~Keiya@06SAAB206.tor-irc.dnsbl.oftc.net) Quit ()
[0:38] * Azerothian______ (~Altitudes@4MJAAEOJK.tor-irc.dnsbl.oftc.net) has joined #ceph
[0:40] * T1 (~the_one@87.104.212.66) has joined #ceph
[0:42] * Heliwr (~Blueraven@06SAAB22A.tor-irc.dnsbl.oftc.net) has joined #ceph
[0:43] * bene2 (~bene@nat-pool-bos-t.redhat.com) Quit (Quit: Konversation terminated!)
[0:43] * tdb (~tdb@myrtle.kent.ac.uk) Quit (Server closed connection)
[0:44] * tdb (~tdb@myrtle.kent.ac.uk) has joined #ceph
[0:47] * The1_ (~the_one@87.104.212.66) Quit (Ping timeout: 480 seconds)
[0:48] * johnavp1989 (~jpetrini@8.39.115.8) Quit (Ping timeout: 480 seconds)
[0:49] * rendar (~I@95.238.176.76) Quit (Quit: std::lower_bound + std::less_equal *works* with a vector without duplicates!)
[0:53] * cholcombe (~chris@12.39.178.125) Quit (Ping timeout: 480 seconds)
[0:54] * theanalyst (theanalyst@open.source.rocks.my.socks.firrre.com) has joined #ceph
[0:57] * stiopa (~stiopa@cpc73832-dals21-2-0-cust453.20-2.cable.virginm.net) Quit (Ping timeout: 480 seconds)
[1:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[1:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[1:02] * blizzow (~jburns@50.243.148.102) Quit (Ping timeout: 480 seconds)
[1:02] * cholcombe (~chris@12.39.178.119) has joined #ceph
[1:02] * alram (~alram@192.41.52.12) Quit (Ping timeout: 480 seconds)
[1:03] * theanalyst (theanalyst@open.source.rocks.my.socks.firrre.com) Quit (Ping timeout: 480 seconds)
[1:08] * Azerothian______ (~Altitudes@4MJAAEOJK.tor-irc.dnsbl.oftc.net) Quit ()
[1:08] * mog_ (~Curt`@exit1.ipredator.se) has joined #ceph
[1:12] * Heliwr (~Blueraven@06SAAB22A.tor-irc.dnsbl.oftc.net) Quit ()
[1:19] * alram (~alram@64.134.221.235) has joined #ceph
[1:25] * fsimonce (~simon@87.13.130.124) Quit (Quit: Coyote finally caught me)
[1:25] * xarses (~xarses@64.124.158.100) Quit (Ping timeout: 480 seconds)
[1:28] * alram (~alram@64.134.221.235) Quit (Quit: leaving)
[1:32] * epheo (~smuxi@ns326280.ip-91-121-67.eu) Quit (Server closed connection)
[1:34] * epheo (~smuxi@ns326280.ip-91-121-67.eu) has joined #ceph
[1:36] * Aim_ (~aim@batroun.rokkanet.org) Quit (Server closed connection)
[1:36] * Aim_ (~aim@batroun.rokkanet.org) has joined #ceph
[1:37] * vata (~vata@cable-21.246.173-197.electronicbox.net) has joined #ceph
[1:38] * mog_ (~Curt`@06SAAB223.tor-irc.dnsbl.oftc.net) Quit ()
[1:41] * lmb (~Lars@2a02:8109:8100:1d2c:f021:41c1:6dbf:f45d) Quit (Server closed connection)
[1:41] * lmb (~Lars@2a02:8109:8100:1d2c:79ec:797:3cab:134e) has joined #ceph
[1:42] * tZ (~Swompie`@freedom.ip-eend.nl) has joined #ceph
[1:42] * Racpatel (~Racpatel@2601:87:3:3601::6f15) Quit (Ping timeout: 480 seconds)
[1:49] * LeaChim (~LeaChim@host86-150-161-6.range86-150.btcentralplus.com) Quit (Ping timeout: 480 seconds)
[1:51] * Racpatel (~Racpatel@2601:87:3:3601::6f15) has joined #ceph
[1:56] * wushudoin (~wushudoin@38.99.12.237) Quit (Ping timeout: 480 seconds)
[1:58] * BrianA (~BrianA@c-50-168-46-112.hsd1.ca.comcast.net) has joined #ceph
[1:58] * MentalRay (~MentalRay@office-mtl1-nat-146-218-70-69.gtcomm.net) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[1:59] * theanalyst (theanalyst@open.source.rocks.my.socks.firrre.com) has joined #ceph
[1:59] * oms101 (~oms101@p20030057EA070900C6D987FFFE4339A1.dip0.t-ipconnect.de) Quit (Ping timeout: 480 seconds)
[2:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[2:01] * sudocat (~dibarra@192.185.1.20) Quit (Ping timeout: 480 seconds)
[2:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[2:02] * tZ (~Swompie`@4MJAAEOK0.tor-irc.dnsbl.oftc.net) Quit (Ping timeout: 482 seconds)
[2:03] * wjw-freebsd2 (~wjw@smtp.digiware.nl) has joined #ceph
[2:03] * Linkshot (~roaet@193.90.12.88) has joined #ceph
[2:06] * shohn (~shohn@dslb-092-078-031-004.092.078.pools.vodafone-ip.de) Quit (Ping timeout: 480 seconds)
[2:07] * theanalyst (theanalyst@open.source.rocks.my.socks.firrre.com) Quit (Ping timeout: 480 seconds)
[2:07] * rdias (~rdias@2001:8a0:749a:d01:d5d8:718:fe40:4d73) Quit (Server closed connection)
[2:07] * oms101 (~oms101@p20030057EA7AA500C6D987FFFE4339A1.dip0.t-ipconnect.de) has joined #ceph
[2:07] * rdias (~rdias@bl7-92-98.dsl.telepac.pt) has joined #ceph
[2:08] * wjw-freebsd (~wjw@smtp.digiware.nl) Quit (Ping timeout: 480 seconds)
[2:08] * lobstar (~sardonyx@tor1e1.privacyfoundation.ch) has joined #ceph
[2:09] * Concubidated (~cube@c-50-173-245-118.hsd1.ca.comcast.net) Quit (Quit: Leaving.)
[2:13] * swami1 (~swami@27.7.165.109) has joined #ceph
[2:15] * vbellur (~vijay@71.234.224.255) has joined #ceph
[2:15] * jermudgeon (~jhaustin@gw1.ttp.biz.whitestone.link) has joined #ceph
[2:16] * barra204 (~barra204@50.250.250.45) Quit (Ping timeout: 480 seconds)
[2:17] * sugoruyo (~georgev@paarthurnax.esc.rl.ac.uk) Quit (Server closed connection)
[2:18] * BrianA (~BrianA@c-50-168-46-112.hsd1.ca.comcast.net) Quit (Read error: Connection reset by peer)
[2:18] * sugoruyo (~georgev@paarthurnax.esc.rl.ac.uk) has joined #ceph
[2:22] * cholcombe (~chris@12.39.178.119) Quit (Ping timeout: 480 seconds)
[2:27] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[2:32] * wjw-freebsd2 (~wjw@smtp.digiware.nl) Quit (Ping timeout: 480 seconds)
[2:33] * Linkshot (~roaet@4MJAAEOLU.tor-irc.dnsbl.oftc.net) Quit ()
[2:33] * LRWerewolf (~JWilbur@207.244.70.35) has joined #ceph
[2:38] * lobstar (~sardonyx@06SAAB247.tor-irc.dnsbl.oftc.net) Quit ()
[2:39] * Esvandiary (~mason@46.183.218.199) has joined #ceph
[2:41] * wgao (~wgao@106.120.101.38) Quit (Read error: Connection timed out)
[2:42] * wgao (~wgao@106.120.101.38) has joined #ceph
[2:44] * theanalyst (theanalyst@open.source.rocks.my.socks.firrre.com) has joined #ceph
[2:45] * theanalyst (theanalyst@open.source.rocks.my.socks.firrre.com) Quit (Max SendQ exceeded)
[2:50] * codice (~toodles@75-128-34-237.static.mtpk.ca.charter.com) has joined #ceph
[2:55] * georgem (~Adium@104-222-119-175.cpe.teksavvy.com) has joined #ceph
[2:55] * georgem (~Adium@104-222-119-175.cpe.teksavvy.com) Quit ()
[2:55] * georgem (~Adium@206.108.127.16) has joined #ceph
[2:56] * Concubidated (~cube@c-50-173-245-118.hsd1.ca.comcast.net) has joined #ceph
[3:01] * The_Ball (~pi@20.92-221-43.customer.lyse.net) Quit (Server closed connection)
[3:01] * The_Ball (~pi@20.92-221-43.customer.lyse.net) has joined #ceph
[3:03] * LRWerewolf (~JWilbur@6AGAABNXS.tor-irc.dnsbl.oftc.net) Quit ()
[3:03] * vasu (~vasu@c-73-231-60-138.hsd1.ca.comcast.net) Quit (Quit: Leaving)
[3:03] * LongyanG (~long@15255.s.time4vps.eu) Quit (Server closed connection)
[3:03] * LongyanG (~long@15255.s.time4vps.eu) has joined #ceph
[3:08] * Esvandiary (~mason@76GAAE2ID.tor-irc.dnsbl.oftc.net) Quit ()
[3:08] * nastidon (~Kwen@relay2.cavefelem.com) has joined #ceph
[3:10] * efirs (~firs@c-50-185-70-125.hsd1.ca.comcast.net) has joined #ceph
[3:11] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[3:11] * csoukup (~csoukup@2605:a601:9c8:6b00:e4e9:e673:4624:2) has joined #ceph
[3:14] * jermudgeon (~jhaustin@gw1.ttp.biz.whitestone.link) Quit (Quit: jermudgeon)
[3:15] * cholcombe (~chris@12.39.178.119) has joined #ceph
[3:17] * atheism (~atheism@182.48.117.114) has joined #ceph
[3:18] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[3:18] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[3:19] * csoukup (~csoukup@2605:a601:9c8:6b00:e4e9:e673:4624:2) Quit (Ping timeout: 480 seconds)
[3:19] * xarses (~xarses@c-73-202-191-48.hsd1.ca.comcast.net) has joined #ceph
[3:19] * theanalyst (theanalyst@open.source.rocks.my.socks.firrre.com) has joined #ceph
[3:22] * DV (~veillard@2001:41d0:a:f29f::1) Quit (Remote host closed the connection)
[3:24] * DV (~veillard@2001:41d0:a:f29f::1) has joined #ceph
[3:27] * EinstCrazy (~EinstCraz@58.247.119.250) has joined #ceph
[3:28] * Mika_c (~quassel@122.146.93.152) has joined #ceph
[3:38] * theanalyst (theanalyst@open.source.rocks.my.socks.firrre.com) Quit (Quit: ZNC - http://znc.in)
[3:38] * Jamana (~TehZomB@4MJAAEOOU.tor-irc.dnsbl.oftc.net) has joined #ceph
[3:38] * nastidon (~Kwen@4MJAAEONZ.tor-irc.dnsbl.oftc.net) Quit ()
[3:38] * Da_Pineapple (~Pieman@76GAAE2JY.tor-irc.dnsbl.oftc.net) has joined #ceph
[3:40] * coyo (~unf@00017955.user.oftc.net) Quit (Ping timeout: 480 seconds)
[3:44] * yanzheng (~zhyan@125.70.21.216) has joined #ceph
[3:44] * swami1 (~swami@27.7.165.109) Quit (Quit: Leaving.)
[3:48] * zhaochao (~zhaochao@125.39.112.2) has joined #ceph
[3:52] * derjohn_mobi (~aj@x4db06240.dyn.telefonica.de) has joined #ceph
[3:52] <ronrib> ah this was a fun one:
[3:52] <ronrib> ls -lah /var/lib/ceph/mon/ceph-0???
[3:52] <ronrib> ls: cannot access /var/lib/ceph/mon/ceph-0???: No such file or directory
[3:53] <ronrib> ls -lah /var/lib/ceph/mon/ceph-0/
[3:53] <ronrib> total 10K
[3:53] <ronrib> drwxr-xr-x 3 ceph ceph 4 May 4 16:21 .
[3:53] <ronrib> drwxr-xr-x 3 ceph ceph 3 May 5 11:43 ..
[3:53] <ronrib> -rw-r--r-- 1 ceph ceph 77 May 4 16:21 keyring
[3:53] <ronrib> drwxr-xr-x 2 ceph ceph 70 May 5 11:44 store.db
[3:53] * shyu (~shyu@119.254.120.71) has joined #ceph
[3:56] * Racpatel (~Racpatel@2601:87:3:3601::6f15) Quit (Ping timeout: 480 seconds)
[3:59] * derjohn_mob (~aj@x590ccec9.dyn.telefonica.de) Quit (Ping timeout: 480 seconds)
[4:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[4:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[4:02] * MentalRay (~MentalRay@107.171.161.165) has joined #ceph
[4:05] * theanalyst (theanalyst@open.source.rocks.my.socks.firrre.com) has joined #ceph
[4:06] * Racpatel (~Racpatel@2601:87:3:3601::6f15) has joined #ceph
[4:07] * Jamana (~TehZomB@4MJAAEOOU.tor-irc.dnsbl.oftc.net) Quit ()
[4:08] * Da_Pineapple (~Pieman@76GAAE2JY.tor-irc.dnsbl.oftc.net) Quit ()
[4:08] * homosaur (~murmur@tor-exit.gansta93.com) has joined #ceph
[4:10] * fdmanana (~fdmanana@2001:8a0:6e0c:6601:990a:ff3e:882:a247) Quit (Ping timeout: 480 seconds)
[4:11] * kefu (~kefu@183.193.162.205) has joined #ceph
[4:12] * theanalyst (theanalyst@open.source.rocks.my.socks.firrre.com) Quit (Quit: ZNC - http://znc.in)
[4:15] * flisky (~Thunderbi@36.110.40.26) has joined #ceph
[4:19] * ira (~ira@c-24-34-255-34.hsd1.ma.comcast.net) Quit (Ping timeout: 480 seconds)
[4:19] * kefu (~kefu@183.193.162.205) Quit (Ping timeout: 480 seconds)
[4:21] * kefu (~kefu@114.92.122.74) has joined #ceph
[4:25] * vicente (~~vicente@125-227-238-55.HINET-IP.hinet.net) has joined #ceph
[4:26] * sankarshan (~sankarsha@121.244.87.117) has joined #ceph
[4:29] * kefu (~kefu@114.92.122.74) Quit (Ping timeout: 480 seconds)
[4:36] * theanalyst (theanalyst@open.source.rocks.my.socks.firrre.com) has joined #ceph
[4:38] * Deiz (~galaxyAbs@tor2r.ins.tor.net.eu.org) has joined #ceph
[4:38] * homosaur (~murmur@06SAAB29D.tor-irc.dnsbl.oftc.net) Quit ()
[4:39] * Tarazed (~csharp@hessel3.torservers.net) has joined #ceph
[4:42] * kefu (~kefu@183.193.162.205) has joined #ceph
[4:44] * theanalyst (theanalyst@open.source.rocks.my.socks.firrre.com) Quit (Ping timeout: 480 seconds)
[4:44] * valeech (~valeech@pool-108-44-162-111.clppva.fios.verizon.net) Quit (Quit: valeech)
[4:55] * khyron (~khyron@fixed-190-159-187-190-159-75.iusacell.net) has joined #ceph
[4:57] * kefu (~kefu@183.193.162.205) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[5:00] * nwf (~nwf@00018577.user.oftc.net) Quit (Ping timeout: 480 seconds)
[5:00] * nwf (~nwf@00018577.user.oftc.net) has joined #ceph
[5:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[5:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[5:08] * Deiz (~galaxyAbs@6AGAABN1L.tor-irc.dnsbl.oftc.net) Quit ()
[5:08] * Tarazed (~csharp@6AGAABN1P.tor-irc.dnsbl.oftc.net) Quit ()
[5:09] * Borf (~maku@tor-exit-4.all.de) has joined #ceph
[5:13] * Borf (~maku@06SAAB3A0.tor-irc.dnsbl.oftc.net) Quit (Remote host closed the connection)
[5:15] * overclk (~quassel@117.202.101.148) has joined #ceph
[5:16] * Helleshin (~tunaaja@95.128.43.164) has joined #ceph
[5:17] * joshd1 (~jdurgin@71-92-201-212.dhcp.gldl.ca.charter.com) has joined #ceph
[5:18] * natarej_ (~natarej@2001:8003:483a:a900:3503:75ed:504b:d53c) has joined #ceph
[5:25] * natarej (~natarej@2001:8003:483a:a900:da8:6a6c:304e:e427) Quit (Ping timeout: 480 seconds)
[5:25] * Vacuum_ (~Vacuum@i59F79A29.versanet.de) has joined #ceph
[5:28] * davidzlap1 (~Adium@2605:e000:1313:8003:514c:5b05:5df9:c7b9) Quit (Quit: Leaving.)
[5:30] * cholcombe (~chris@12.39.178.119) Quit (Quit: Leaving)
[5:32] * Vacuum__ (~Vacuum@i59F790E2.versanet.de) Quit (Ping timeout: 480 seconds)
[5:32] * valeech (~valeech@pool-108-44-162-111.clppva.fios.verizon.net) has joined #ceph
[5:36] * theanalyst (theanalyst@open.source.rocks.my.socks.firrre.com) has joined #ceph
[5:37] * georgem (~Adium@206.108.127.16) Quit (Quit: Leaving.)
[5:38] * Neon (~AG_Scott@marylou.nos-oignons.net) has joined #ceph
[5:38] * valeech (~valeech@pool-108-44-162-111.clppva.fios.verizon.net) Quit (Quit: valeech)
[5:46] * Helleshin (~tunaaja@4MJAAEORF.tor-irc.dnsbl.oftc.net) Quit ()
[5:46] * click1 (~Scaevolus@46.166.188.218) has joined #ceph
[6:00] * ircuser-1 (~Johnny@158.183-62-69.ftth.swbr.surewest.net) Quit (Quit: because)
[6:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[6:01] * theanalyst (theanalyst@open.source.rocks.my.socks.firrre.com) Quit (Ping timeout: 480 seconds)
[6:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[6:05] * wgao (~wgao@106.120.101.38) Quit (Ping timeout: 480 seconds)
[6:08] * Neon (~AG_Scott@7V7AAEBVO.tor-irc.dnsbl.oftc.net) Quit ()
[6:08] * shyu (~shyu@119.254.120.71) Quit (Quit: Leaving)
[6:08] * shyu (~shyu@119.254.120.71) has joined #ceph
[6:09] * shohn (~shohn@dslb-092-078-031-004.092.078.pools.vodafone-ip.de) has joined #ceph
[6:12] * Catsceo (~Gibri@host-200-176.junet.se) has joined #ceph
[6:13] * wgao (~wgao@106.120.101.38) has joined #ceph
[6:16] * click1 (~Scaevolus@76GAAE2M6.tor-irc.dnsbl.oftc.net) Quit ()
[6:16] * CorneliousJD|AtWork (~adept256@162.247.73.204) has joined #ceph
[6:22] * kefu (~kefu@183.193.162.205) has joined #ceph
[6:23] * kefu_ (~kefu@114.92.122.74) has joined #ceph
[6:30] * kefu (~kefu@183.193.162.205) Quit (Ping timeout: 480 seconds)
[6:34] * Skaag (~lunix@rrcs-67-52-140-5.west.biz.rr.com) Quit (Quit: Leaving.)
[6:42] * Catsceo (~Gibri@6AGAABN4K.tor-irc.dnsbl.oftc.net) Quit ()
[6:46] * CorneliousJD|AtWork (~adept256@7V7AAEBV1.tor-irc.dnsbl.oftc.net) Quit ()
[6:46] * mr_flea1 (~Jones@4MJAAEOT7.tor-irc.dnsbl.oftc.net) has joined #ceph
[6:52] * swami1 (~swami@49.32.0.40) has joined #ceph
[6:59] * branto (~branto@178.253.163.131) has joined #ceph
[6:59] * nwf (~nwf@00018577.user.oftc.net) Quit (Ping timeout: 480 seconds)
[7:00] * _28_ria (~kvirc@opfr028.ru) Quit (Read error: Connection reset by peer)
[7:00] * nwf (~nwf@00018577.user.oftc.net) has joined #ceph
[7:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[7:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[7:08] * canta (~canta@p508756D7.dip0.t-ipconnect.de) has joined #ceph
[7:12] * LRWerewolf (~Knuckx@edwardsnowden2.torservers.net) has joined #ceph
[7:14] * dhx (~canta@p508755BB.dip0.t-ipconnect.de) Quit (Ping timeout: 480 seconds)
[7:16] * mr_flea1 (~Jones@4MJAAEOT7.tor-irc.dnsbl.oftc.net) Quit ()
[7:16] * jwandborg (~PappI@hessel0.torservers.net) has joined #ceph
[7:16] * theanalyst (theanalyst@open.source.rocks.my.socks.firrre.com) has joined #ceph
[7:18] * deepthi (~deepthi@106.206.145.25) has joined #ceph
[7:25] * theanalyst (theanalyst@open.source.rocks.my.socks.firrre.com) Quit (Ping timeout: 480 seconds)
[7:26] * rraja (~rraja@121.244.87.117) has joined #ceph
[7:27] * IvanJobs (~hardes@103.50.11.146) has joined #ceph
[7:28] <IvanJobs> I'm testing ceph block device's IOPS, why rand write IOPS was much higher than seq write? can anyone explain that?
[7:29] * KindOne_ (kindone@h123.40.30.71.dynamic.ip.windstream.net) has joined #ceph
[7:33] * KindOne (kindone@h183.41.30.71.dynamic.ip.windstream.net) Quit (Ping timeout: 480 seconds)
[7:33] * KindOne_ is now known as KindOne
[7:39] * MentalRay (~MentalRay@107.171.161.165) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[7:39] * huangjun (~kvirc@113.57.168.154) has joined #ceph
[7:42] * LRWerewolf (~Knuckx@6AGAABN50.tor-irc.dnsbl.oftc.net) Quit ()
[7:45] * linuxkidd (~linuxkidd@241.sub-70-210-192.myvzw.com) Quit (Remote host closed the connection)
[7:46] * jwandborg (~PappI@4MJAAEOU6.tor-irc.dnsbl.oftc.net) Quit ()
[7:46] * Joppe4899 (~toast@109.201.133.100) has joined #ceph
[7:49] * rdas (~rdas@27.58.28.183) has joined #ceph
[7:53] * swami1 (~swami@49.32.0.40) Quit (Quit: Leaving.)
[7:55] * swami1 (~swami@49.32.0.40) has joined #ceph
[8:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[8:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[8:04] * swami2 (~swami@49.44.57.245) has joined #ceph
[8:09] * post-factum (~post-fact@vulcan.natalenko.name) Quit (Killed (NickServ (Too many failed password attempts.)))
[8:09] * post-factum (~post-fact@vulcan.natalenko.name) has joined #ceph
[8:10] * swami1 (~swami@49.32.0.40) Quit (Ping timeout: 480 seconds)
[8:12] * sankarshan (~sankarsha@121.244.87.117) Quit (Quit: Are you sure you want to quit this channel (Cancel/Ok) ?)
[8:12] * dotblank1 (~hgjhgjh@edwardsnowden1.torservers.net) has joined #ceph
[8:14] * geli (~geli@geli-2015.its.utas.edu.au) Quit (Quit: Leaving.)
[8:14] * karnan (~karnan@121.244.87.118) has joined #ceph
[8:16] * Joppe4899 (~toast@76GAAE2PX.tor-irc.dnsbl.oftc.net) Quit ()
[8:17] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[8:22] * DV (~veillard@2001:41d0:a:f29f::1) Quit (Remote host closed the connection)
[8:23] * DV (~veillard@2001:41d0:a:f29f::1) has joined #ceph
[8:31] * IvanJobs (~hardes@103.50.11.146) Quit (Ping timeout: 480 seconds)
[8:36] * swami1 (~swami@49.32.0.40) has joined #ceph
[8:37] * shylesh (~shylesh@121.244.87.118) has joined #ceph
[8:42] * swami2 (~swami@49.44.57.245) Quit (Ping timeout: 480 seconds)
[8:42] * dotblank1 (~hgjhgjh@76GAAE2QL.tor-irc.dnsbl.oftc.net) Quit ()
[8:42] * neobenedict (~SinZ|offl@76GAAE2Q9.tor-irc.dnsbl.oftc.net) has joined #ceph
[8:44] * shohn (~shohn@dslb-092-078-031-004.092.078.pools.vodafone-ip.de) Quit (Quit: Leaving.)
[8:44] * MentalRay (~MentalRay@107.171.161.165) has joined #ceph
[8:46] * EinstCrazy (~EinstCraz@58.247.119.250) Quit (Remote host closed the connection)
[8:46] * EinstCrazy (~EinstCraz@58.247.119.250) has joined #ceph
[8:48] * natarej_ (~natarej@2001:8003:483a:a900:3503:75ed:504b:d53c) Quit (Quit: Leaving)
[8:51] * Spessu (~LRWerewol@ns316491.ip-37-187-129.eu) has joined #ceph
[8:55] * IvanJobs (~hardes@103.50.11.146) has joined #ceph
[9:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[9:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[9:01] * joshd1 (~jdurgin@71-92-201-212.dhcp.gldl.ca.charter.com) Quit (Quit: Leaving.)
[9:02] * geli (~geli@geli-2015.its.utas.edu.au) has joined #ceph
[9:09] <canta> IvanJobs: How was the test configured?
[9:11] <IvanJobs> canta: this is my fio conf file: http://paste.ubuntu.com/16231611/
[9:12] * neobenedict (~SinZ|offl@76GAAE2Q9.tor-irc.dnsbl.oftc.net) Quit ()
[9:12] <IvanJobs> in this conf file, I tested block device directly, the same result comes out with filesystem.
[9:12] * kiasyn (~PierreW@86.104.15.15) has joined #ceph
[9:13] <IvanJobs> I guess this is related to ceph features. But can't get any detail clue.
[9:14] <IvanJobs> I'm looking into details of librbd now, hope will get some explanations.
[9:15] <canta> how does it look when you use an iodepth of 1?
[9:16] <IvanJobs> wait, I will try it.
[9:17] * MentalRay (~MentalRay@107.171.161.165) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[9:18] * rakeshgm (~rakesh@121.244.87.117) has joined #ceph
[9:18] * fsimonce (~simon@87.13.130.124) has joined #ceph
[9:19] * Hemanth (~hkumar_@121.244.87.117) has joined #ceph
[9:19] <canta> you might want to rule out any os-level caching, so a test like the one sebastien-han proposed for the capabilities of journal-ssds might show more barebone numbers in that regard
[9:20] * Spessu (~LRWerewol@76GAAE2RK.tor-irc.dnsbl.oftc.net) Quit ()
[9:22] * analbeard (~shw@support.memset.com) has joined #ceph
[9:23] * DV (~veillard@2001:41d0:a:f29f::1) Quit (Remote host closed the connection)
[9:23] * kawa2014 (~kawa@89.184.114.246) has joined #ceph
[9:23] * DV (~veillard@2001:41d0:a:f29f::1) has joined #ceph
[9:24] * bara (~bara@nat-pool-brq-t.redhat.com) has joined #ceph
[9:29] * rraja (~rraja@121.244.87.117) Quit (Quit: Leaving)
[9:29] * itamarl is now known as Guest2790
[9:30] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[9:34] * Guest2790 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[9:34] <IvanJobs> canta: i have made a test for iodepth 1, iops are pretty the same, but seq write is better than rand write a bit.
[9:35] * owasserm (~owasserm@bzq-79-178-144-247.red.bezeqint.net) has joined #ceph
[9:36] * ngoswami (~ngoswami@1.39.85.11) has joined #ceph
[9:36] <canta> My theory then is as follows, randwrite with big iodepth enables relatively efficient write batching accross more object, so that other(/and more) PGs are involved in fullfilling request, more PGs, more OSDs, more backend-storage io capabilities.
[9:38] * theanalyst (theanalyst@open.source.rocks.my.socks.firrre.com) has joined #ceph
[9:42] <IvanJobs> canta: so which config item should I refer to? I want to know back-end object size of rbd image.
[9:42] * kiasyn (~PierreW@06SAAB3H4.tor-irc.dnsbl.oftc.net) Quit ()
[9:42] * raindog (~tZ@exit1.ipredator.se) has joined #ceph
[9:43] <IvanJobs> canta: I agree with u. aio with rand write can cross more objects in more PGs, so more OSDs would participated in, get more IOPS and bandwidth.
[9:44] <canta> the default is rbd object size 4 MB, you can look into striping, or smaller objects.
[9:44] <canta> usually a rbd info $pool/$imagename will show you the information
[9:45] <Nats_> why are you testing sequential iops ?
[9:45] * rendar (~I@82.61.125.242) has joined #ceph
[9:46] <canta> that seems to be the better question, now that I see it.
[9:47] <Nats_> i personally would argue random 4k iops is the only thing that matters, but the typical tests you would see are 4k random and 4M sequential
[9:47] <Nats_> measuring iops and mb/sec respectively
[9:50] <canta> in that regard.. is striping as good as using smaller object? In my understanding striping just move the cost of it from the osds to librbd
[9:51] * Jones (~ItsCrimin@exit1.ipredator.se) has joined #ceph
[9:54] * drnexus (~cmorandin@boc06-4-78-216-15-170.fbx.proxad.net) has joined #ceph
[9:54] * theanalyst (theanalyst@open.source.rocks.my.socks.firrre.com) Quit (Quit: ZNC - http://znc.in)
[9:59] * cmorandin (~cmorandin@boc06-4-78-216-15-170.fbx.proxad.net) has joined #ceph
[10:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[10:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[10:02] <IvanJobs> thx canta, I got it now.
[10:09] * raarts (~Adium@82-171-243-109.ip.telfort.nl) has joined #ceph
[10:12] * raindog (~tZ@6AGAABOAK.tor-irc.dnsbl.oftc.net) Quit ()
[10:12] * verbalins (~Bored@06SAAB3JY.tor-irc.dnsbl.oftc.net) has joined #ceph
[10:14] * Concubidated (~cube@c-50-173-245-118.hsd1.ca.comcast.net) Quit (Quit: Leaving.)
[10:20] * Jones (~ItsCrimin@4MJAAEOY9.tor-irc.dnsbl.oftc.net) Quit ()
[10:21] * Schaap (~hgjhgjh@7V7AAEBZF.tor-irc.dnsbl.oftc.net) has joined #ceph
[10:37] * ngoswami_ (~ngoswami@1.39.85.11) has joined #ceph
[10:42] * verbalins (~Bored@06SAAB3JY.tor-irc.dnsbl.oftc.net) Quit ()
[10:42] * Crisco (~Oddtwang@207.244.70.35) has joined #ceph
[10:44] * ngoswami (~ngoswami@1.39.85.11) Quit (Ping timeout: 480 seconds)
[10:44] * theanalyst (theanalyst@open.source.rocks.my.socks.firrre.com) has joined #ceph
[10:47] * theanalyst (theanalyst@open.source.rocks.my.socks.firrre.com) Quit (Remote host closed the connection)
[10:49] * rraja (~rraja@121.244.87.117) has joined #ceph
[10:50] * Schaap (~hgjhgjh@7V7AAEBZF.tor-irc.dnsbl.oftc.net) Quit ()
[10:51] * nicatronTg (~Architect@hessel3.torservers.net) has joined #ceph
[10:51] * DanFoster (~Daniel@2a00:1ee0:3:1337:c179:26e9:7480:4d2d) has joined #ceph
[10:52] * LeaChim (~LeaChim@host86-150-161-6.range86-150.btcentralplus.com) has joined #ceph
[10:56] * ircuser-1 (~Johnny@158.183-62-69.ftth.swbr.surewest.net) has joined #ceph
[10:58] * wjw-freebsd (~wjw@smtp.digiware.nl) has joined #ceph
[10:59] * cmorandin (~cmorandin@boc06-4-78-216-15-170.fbx.proxad.net) Quit (Ping timeout: 480 seconds)
[10:59] * drnexus (~cmorandin@boc06-4-78-216-15-170.fbx.proxad.net) Quit (Ping timeout: 480 seconds)
[11:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[11:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[11:02] <sugoruyo> hey folks, can anyone help figure out a problem with PGs stuck incomplete?
[11:09] * fdmanana (~fdmanana@2001:8a0:6e0c:6601:8ae:4653:621a:dc3a) has joined #ceph
[11:09] <titzer> I'm not an expert, but I guess I can help think about it
[11:09] <titzer> are there a lot of them?
[11:10] * efirs (~firs@c-50-185-70-125.hsd1.ca.comcast.net) Quit (Quit: Leaving.)
[11:12] * Crisco (~Oddtwang@06SAAB3KL.tor-irc.dnsbl.oftc.net) Quit ()
[11:13] * zhaochao (~zhaochao@125.39.112.2) Quit (Ping timeout: 480 seconds)
[11:13] <sugoruyo> titzer: I have 4 incomplete PGs
[11:13] <titzer> on the same osd?
[11:14] <sugoruyo> they are part of a replicated pull and they all had the same OSD as their primary
[11:14] <sugoruyo> that OSDs host is having a lot trouble so we decided to take it out
[11:15] <sugoruyo> once we did those PGs became mapped to a completely different set of OSDs (as in, all 3 OSDs changed) and became incomplete
[11:15] * zhaochao (~zhaochao@124.202.191.130) has joined #ceph
[11:15] <sugoruyo> out of the new set only one OSD actually has data for that PG, it seems to be the right amount of data, but right now I don't know if it's correct
[11:16] <titzer> and all the osds are up and up now?
[11:17] <titzer> I'll think about it for a bit. Also with this information, there may be others that also may know the best solution :)
[11:18] <sugoruyo> no, although I've tried various combinations, like bringing up the OSD on the problematic machine or keep that down and bringing up the new primary, bringing them both up etc.
[11:18] <titzer> oh, I see
[11:19] <titzer> how many replicas?
[11:19] <sugoruyo> the problem is the most cited solution involves re-creating the PG and this pool is used for copy-on-write RBD images in a production environment.
[11:19] <titzer> or what's the size set at, I should say
[11:19] <sugoruyo> 3 replicas, we're running Hammer and have not yet switched to straw2 (which might have something to do with 1 OSD leaving -> PGs changing their entire set)
[11:20] <sugoruyo> min_size 2 (I tried bringing down to 1) and size 3
[11:20] <titzer> m'kay
[11:20] * nicatronTg (~Architect@7V7AAEBZ1.tor-irc.dnsbl.oftc.net) Quit ()
[11:21] <titzer> I'll bounce it around my head for a while and get back to you if I can think of something clever. Otherwise just stick around and maybe someone else will chime in
[11:22] * shyu (~shyu@119.254.120.71) Quit (Remote host closed the connection)
[11:25] * sixofour (~pakman__@76GAAE2VJ.tor-irc.dnsbl.oftc.net) has joined #ceph
[11:35] * karnan (~karnan@121.244.87.118) Quit (Ping timeout: 480 seconds)
[11:37] * ngoswami__ (~ngoswami@1.39.85.11) has joined #ceph
[11:42] * Morde (~Thayli@93.174.93.133) has joined #ceph
[11:43] * rdas (~rdas@27.58.28.183) Quit (Quit: Leaving)
[11:44] * ngoswami_ (~ngoswami@1.39.85.11) Quit (Ping timeout: 480 seconds)
[11:52] * ngoswami__ (~ngoswami@1.39.85.11) Quit (Quit: This computer has gone to sleep)
[11:55] * sixofour (~pakman__@76GAAE2VJ.tor-irc.dnsbl.oftc.net) Quit ()
[11:55] * Tenk (~Averad@edwardsnowden1.torservers.net) has joined #ceph
[12:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[12:01] <titzer> sorry sugoruyo, I can't come up with anything. I do wish you the best of luck and hopefully someone else knows
[12:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[12:02] * _28_ria (~kvirc@opfr028.ru) has joined #ceph
[12:03] <sugoruyo> titzer: that's alright, I'll probably post on the mailing list about it and see if people can help. I'm actually wondering if I can just copy PG data from one OSD to another and have it boot up and recognise it...
[12:05] * Hemanth (~hkumar_@121.244.87.117) Quit (Ping timeout: 480 seconds)
[12:10] * morse (~morse@supercomputing.univpm.it) Quit (Ping timeout: 480 seconds)
[12:11] * morse (~morse@supercomputing.univpm.it) has joined #ceph
[12:12] * Morde (~Thayli@76GAAE2VY.tor-irc.dnsbl.oftc.net) Quit ()
[12:18] * Hemanth (~hkumar_@121.244.87.118) has joined #ceph
[12:18] <titzer> that would be interesting to know. Got a test cluster?
[12:18] * Mika_c (~quassel@122.146.93.152) Quit (Remote host closed the connection)
[12:22] * ngoswami__ (~ngoswami@1.39.85.11) has joined #ceph
[12:25] * Tenk (~Averad@06SAAB3MG.tor-irc.dnsbl.oftc.net) Quit ()
[12:25] * clusterfudge (~nih@edwardsnowden1.torservers.net) has joined #ceph
[12:26] * IvanJobs (~hardes@103.50.11.146) Quit (Ping timeout: 480 seconds)
[12:27] * PoRNo-MoRoZ (~hp1ng@mail.ap-team.ru) Quit ()
[12:32] * morse_ (~morse@supercomputing.univpm.it) has joined #ceph
[12:34] <sugoruyo> titzer: yeah, we have a test cluster but it's not currently available to test this with.
[12:36] * morse_ (~morse@supercomputing.univpm.it) Quit ()
[12:36] * morse (~morse@supercomputing.univpm.it) Quit (Ping timeout: 480 seconds)
[12:37] * morse (~morse@supercomputing.univpm.it) has joined #ceph
[12:38] <raarts> ceph noob here. just installed a cluster with one mon and 2 osd (each 10GB XFS disk with 1GB journal). ceph -w tells met this:
[12:38] <raarts> cluster 21ba9737-3801-4893-9bc9-0e2c677b08f7
[12:38] <raarts> health HEALTH_WARN
[12:38] <raarts> 33 pgs degraded
[12:38] <raarts> 31 pgs peering
[12:38] <raarts> 33 pgs stuck degraded
[12:38] <raarts> 31 pgs stuck inactive
[12:38] <raarts> 64 pgs stuck unclean
[12:38] <raarts> 33 pgs stuck undersized
[12:38] <raarts> 33 pgs undersized
[12:38] <raarts> monmap e1: 1 mons at {manager-1=10.100.199.10:6789/0}
[12:38] <raarts> election epoch 2, quorum 0 manager-1
[12:38] <raarts> osdmap e9: 2 osds: 2 up, 2 in
[12:38] <raarts> flags sortbitwise
[12:39] <raarts> pgmap v16: 64 pgs, 1 pools, 0 bytes data, 0 objects
[12:39] <raarts> 2113 MB used, 18346 MB / 20460 MB avail
[12:39] <raarts> 33 active+undersized+degraded
[12:39] <raarts> 31 peering
[12:39] <raarts> unsure how to proceed
[12:39] * karnan (~karnan@106.51.142.65) has joined #ceph
[12:39] <sugoruyo> raarts: what is the "size" of your pool?
[12:40] <raarts> how do I find out? my last command was ceph-deploy osd activate
[12:40] <sugoruyo> ceph osd pool get <pool-name> size
[12:41] <raarts> I don't even have a pool yet, I didn;t get to that. I just installed the cluster, and haven't done anything with it
[12:41] * EinstCrazy (~EinstCraz@58.247.119.250) Quit (Remote host closed the connection)
[12:41] * krypto (~krypto@125.16.137.146) has joined #ceph
[12:41] <sugoruyo> yeah you do, it says so here: pgmap v16: 64 pgs, 1 pools, 0 bytes data, 0 objects
[12:42] <sugoruyo> you have a pool with 64 PGs, and I'm guessing it's trying to do 3-way replication and not finding enough OSDs
[12:42] * itamarl is now known as Guest2802
[12:42] * itamarl (~itamarl@194.90.7.244) has joined #ceph
[12:42] * Salamander_ (~Jase@4MJAAEO3B.tor-irc.dnsbl.oftc.net) has joined #ceph
[12:42] <raarts> I specifcied 'osd pool default size = 2' in the global section
[12:43] * Guest2802 (~itamarl@194.90.7.244) Quit (Ping timeout: 480 seconds)
[12:44] * morse_ (~morse@supercomputing.univpm.it) has joined #ceph
[12:45] * huangjun (~kvirc@113.57.168.154) Quit (Ping timeout: 480 seconds)
[12:46] <sugoruyo> raarts: hmm, can you still check the size of that pool? undersized PGs means it can't find enough OSDs to assign them a proper acting set.
[12:48] * morse (~morse@supercomputing.univpm.it) Quit (Ping timeout: 480 seconds)
[12:48] <raarts> sugoruyo: ceph osd pool get rbd size
[12:48] <raarts> size: 2
[12:49] * DanFoster (~Daniel@2a00:1ee0:3:1337:c179:26e9:7480:4d2d) Quit (Ping timeout: 480 seconds)
[12:50] * lkoranda (~lkoranda@nat-pool-brq-t.redhat.com) Quit (Max SendQ exceeded)
[12:50] * lkoranda (~lkoranda@nat-pool-brq-t.redhat.com) has joined #ceph
[12:54] * theanalyst (theanalyst@open.source.rocks.my.socks.firrre.com) has joined #ceph
[12:55] * clusterfudge (~nih@7V7AAEB1L.tor-irc.dnsbl.oftc.net) Quit ()
[12:55] * DoDzy (~Hejt@76GAAE2XU.tor-irc.dnsbl.oftc.net) has joined #ceph
[12:59] <sugoruyo> raarts: that's interesting. I'm not sure what's going on with your PGs then. It could be the case that you have too many. Sorry, have to go now, I'll be back. If you add more OSDs that should fix itself.
[13:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[13:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[13:01] <raarts> sugoruyo: ok, thanks
[13:05] * rakeshgm (~rakesh@121.244.87.117) Quit (Ping timeout: 480 seconds)
[13:05] * valeech (~valeech@pool-108-44-162-111.clppva.fios.verizon.net) has joined #ceph
[13:07] * DanFoster (~Daniel@2a00:1ee0:3:1337:c179:26e9:7480:4d2d) has joined #ceph
[13:08] * bniver (~bniver@pool-173-48-58-27.bstnma.fios.verizon.net) Quit (Remote host closed the connection)
[13:08] * rakeshgm (~rakesh@121.244.87.118) has joined #ceph
[13:08] * jclm (~jclm@marriott-hotel-ottawa-yowmc.sites.intello.com) Quit (Ping timeout: 480 seconds)
[13:09] <raarts> sugoruyo: turns out to have been the firewall settings. One of the OSD'a was unreachable.
[13:09] * sudocat (~dibarra@2602:306:8bc7:4c50:6d64:ff65:7929:6baa) has joined #ceph
[13:09] * DanFoster (~Daniel@2a00:1ee0:3:1337:c179:26e9:7480:4d2d) Quit (Read error: Network is unreachable)
[13:10] * DanFoster (~Daniel@85.255.233.90) has joined #ceph
[13:12] * Salamander_ (~Jase@4MJAAEO3B.tor-irc.dnsbl.oftc.net) Quit ()
[13:13] * Hemanth (~hkumar_@121.244.87.118) Quit (Ping timeout: 480 seconds)
[13:14] * nils_ (~nils_@doomstreet.collins.kg) has joined #ceph
[13:14] * morse_ (~morse@supercomputing.univpm.it) Quit (Ping timeout: 480 seconds)
[13:15] * vicente (~~vicente@125-227-238-55.HINET-IP.hinet.net) Quit (Quit: Leaving)
[13:15] * nwf (~nwf@00018577.user.oftc.net) Quit (Ping timeout: 480 seconds)
[13:16] * zhaochao (~zhaochao@124.202.191.130) Quit (Quit: ChatZilla 0.9.92 [Firefox 45.1.0/20160426232238])
[13:16] * nwf (~nwf@00018577.user.oftc.net) has joined #ceph
[13:19] * atheism (~atheism@182.48.117.114) Quit (Ping timeout: 480 seconds)
[13:20] * daviddcc (~dcasier@84.197.151.77.rev.sfr.net) has joined #ceph
[13:23] * ngoswami_ (~ngoswami@1.39.85.11) has joined #ceph
[13:25] * DoDzy (~Hejt@76GAAE2XU.tor-irc.dnsbl.oftc.net) Quit ()
[13:30] * danielsj (~airsoftgl@h-130-176.a2.corp.bahnhof.no) has joined #ceph
[13:30] * ngoswami__ (~ngoswami@1.39.85.11) Quit (Ping timeout: 480 seconds)
[13:30] * ira (~ira@c-24-34-255-34.hsd1.ma.comcast.net) has joined #ceph
[13:31] * pmanny (~rodri@14.139.82.6) Quit (Ping timeout: 480 seconds)
[13:31] * owasserm (~owasserm@bzq-79-178-144-247.red.bezeqint.net) Quit (Ping timeout: 480 seconds)
[13:32] * Hemanth (~hkumar_@121.244.87.117) has joined #ceph
[13:41] * pmanny (~rodri@146.185.31.226) has joined #ceph
[13:42] * Xylios (~eXeler0n@tor-exit.eecs.umich.edu) has joined #ceph
[13:50] * flisky (~Thunderbi@36.110.40.26) Quit (Quit: flisky)
[13:51] * jclm (~jclm@72.143.50.126) has joined #ceph
[13:57] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[13:59] * Racpatel (~Racpatel@2601:87:3:3601::6f15) Quit (Ping timeout: 480 seconds)
[13:59] * danielsj (~airsoftgl@6AGAABOGN.tor-irc.dnsbl.oftc.net) Quit ()
[14:00] * tZ (~oracular@6AGAABOHP.tor-irc.dnsbl.oftc.net) has joined #ceph
[14:12] * overclk_ (~quassel@117.202.101.220) has joined #ceph
[14:12] * Xylios (~eXeler0n@7V7AAEB2V.tor-irc.dnsbl.oftc.net) Quit ()
[14:12] * MKoR (~Averad@06SAAB3Q9.tor-irc.dnsbl.oftc.net) has joined #ceph
[14:14] * nils_ (~nils_@doomstreet.collins.kg) Quit (Quit: This computer has gone to sleep)
[14:15] * billwebb (~billwebb@50-203-47-138-static.hfc.comcastbusiness.net) has joined #ceph
[14:15] * overclk (~quassel@117.202.101.148) Quit (Ping timeout: 480 seconds)
[14:16] * kefu_ (~kefu@114.92.122.74) Quit (Quit: Textual IRC Client: www.textualapp.com)
[14:23] * mattbenjamin (~mbenjamin@76-206-42-50.lightspeed.livnmi.sbcglobal.net) has joined #ceph
[14:23] * kefu (~kefu@114.92.122.74) has joined #ceph
[14:24] * i_m (~ivan.miro@deibp9eh1--blueice4n5.emea.ibm.com) has joined #ceph
[14:26] * nwf (~nwf@00018577.user.oftc.net) Quit (Ping timeout: 480 seconds)
[14:26] * nwf (~nwf@00018577.user.oftc.net) has joined #ceph
[14:29] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[14:30] * tZ (~oracular@6AGAABOHP.tor-irc.dnsbl.oftc.net) Quit ()
[14:30] * Tumm (~Hazmat@exit1.torproxy.org) has joined #ceph
[14:30] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[14:30] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[14:30] * ngoswami__ (~ngoswami@1.39.85.11) has joined #ceph
[14:30] * ngoswami_ (~ngoswami@1.39.85.11) Quit (Ping timeout: 480 seconds)
[14:30] * shylesh (~shylesh@121.244.87.118) Quit (Remote host closed the connection)
[14:32] * scuttle|afk is now known as scuttlemonkey
[14:33] * bniver (~bniver@nat-pool-bos-u.redhat.com) has joined #ceph
[14:36] * shyu (~shyu@111.201.69.237) has joined #ceph
[14:38] * overclk (~quassel@117.202.101.157) has joined #ceph
[14:39] * vikhyat (~vumrao@123.252.242.58) has joined #ceph
[14:39] * overclk_ (~quassel@117.202.101.220) Quit (Ping timeout: 480 seconds)
[14:42] <sugoruyo> raarts: oooooooh, I wouldn't have thought that to be a problem... are you running this on VMs or something?
[14:42] * MKoR (~Averad@06SAAB3Q9.tor-irc.dnsbl.oftc.net) Quit ()
[14:42] * Crisco (~BlS@tor-exit.eecs.umich.edu) has joined #ceph
[14:43] <raarts> sugoruyo: yes on parallels on my mac
[14:43] <raarts> sugoruyo: but it's working now, happily testing rbd's
[14:44] * huangjun (~kvirc@117.152.74.203) has joined #ceph
[14:47] * scuttlemonkey is now known as scuttle|afk
[14:49] * mattbenjamin (~mbenjamin@76-206-42-50.lightspeed.livnmi.sbcglobal.net) Quit (Ping timeout: 480 seconds)
[14:50] <sugoruyo> raarts: yeah, if you run stuff on VMs you can expect network configuration to be more of an issue.
[14:52] * georgem (~Adium@206.108.127.16) has joined #ceph
[14:55] * nwf (~nwf@00018577.user.oftc.net) Quit (Ping timeout: 480 seconds)
[14:56] * nwf (~nwf@00018577.user.oftc.net) has joined #ceph
[14:58] * rakeshgm (~rakesh@121.244.87.118) Quit (Quit: Leaving)
[14:58] * billwebb (~billwebb@50-203-47-138-static.hfc.comcastbusiness.net) Quit (Quit: billwebb)
[14:58] * rakeshgm (~rakesh@121.244.87.118) has joined #ceph
[14:58] * rakesh_ (~rakesh@121.244.87.117) has joined #ceph
[14:59] * billwebb (~billwebb@50-203-47-138-static.hfc.comcastbusiness.net) has joined #ceph
[15:00] * Tumm (~Hazmat@4MJAAEO5V.tor-irc.dnsbl.oftc.net) Quit ()
[15:00] * SaneSmith1 (~RaidSoft@198.50.200.139) has joined #ceph
[15:00] * brad_mssw (~brad@66.129.88.50) has joined #ceph
[15:00] * yanzheng (~zhyan@125.70.21.216) Quit (Quit: This computer has gone to sleep)
[15:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[15:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[15:01] * yanzheng (~zhyan@125.70.21.216) has joined #ceph
[15:05] * kefu (~kefu@114.92.122.74) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[15:06] * rakeshgm (~rakesh@121.244.87.118) Quit (Ping timeout: 480 seconds)
[15:07] * Racpatel (~Racpatel@2601:87:3:3601::6f15) has joined #ceph
[15:08] * karnan (~karnan@106.51.142.65) Quit (Ping timeout: 480 seconds)
[15:09] * johnavp1989 (~jpetrini@8.39.115.8) has joined #ceph
[15:10] * kefu (~kefu@183.193.162.205) has joined #ceph
[15:12] * overclk_ (~quassel@117.202.97.200) has joined #ceph
[15:12] * Crisco (~BlS@4MJAAEO56.tor-irc.dnsbl.oftc.net) Quit ()
[15:12] * mps (~PierreW@Relay-J.tor-exit.network) has joined #ceph
[15:13] * alkaid (~alkaid@128.199.95.148) has joined #ceph
[15:13] * bara (~bara@nat-pool-brq-t.redhat.com) Quit (Quit: Bye guys! (??????????????????? ?????????)
[15:15] * overclk (~quassel@117.202.101.157) Quit (Ping timeout: 480 seconds)
[15:16] <raarts> oops: kernel panic when mounting cephfs filesystem on client. All hosts are debian jesse 8.4
[15:16] * pmanny (~rodri@146.185.31.226) Quit (Ping timeout: 480 seconds)
[15:16] * bara (~bara@nat-pool-brq-t.redhat.com) has joined #ceph
[15:19] * Racpatel (~Racpatel@2601:87:3:3601::6f15) Quit (Quit: Leaving)
[15:19] * Racpatel (~Racpatel@2601:87:3:3601::6f15) has joined #ceph
[15:19] * krypto (~krypto@125.16.137.146) Quit (Read error: Connection reset by peer)
[15:21] * owasserm (~owasserm@87.71.34.43) has joined #ceph
[15:24] <raarts> ok, kernel panic is known problem.
[15:26] * itamarl (~itamarl@194.90.7.244) Quit (Quit: itamarl)
[15:27] * kefu is now known as kefu|afk
[15:29] * pmanny (~rodri@146.185.31.226) has joined #ceph
[15:30] * SaneSmith1 (~RaidSoft@4MJAAEO6N.tor-irc.dnsbl.oftc.net) Quit ()
[15:31] * ngoswami_ (~ngoswami@1.39.85.11) has joined #ceph
[15:33] * atheism (~atheism@106.38.140.252) has joined #ceph
[15:34] <alkaid> hello, I need some help about ceph rbd. With kernel 3.10.0.-327(centos7), processes enter D status seldom.
[15:34] * dmanchad (~David@95.red-2-136-103.dynamicip.rima-tde.net) has joined #ceph
[15:34] * kefu|afk is now known as kefu
[15:34] * Bj_o_rn (~CoZmicShR@torsrvs.snydernet.net) has joined #ceph
[15:34] * dmanchad (~David@95.red-2-136-103.dynamicip.rima-tde.net) Quit ()
[15:34] <alkaid> I have created an issue on tracker http://tracker.ceph.com/issues/15694 but there has been no comment yet.
[15:35] * jclm1 (~jclm@72.143.50.126) has joined #ceph
[15:36] <alkaid> debian jessie kernel 3.16 doesn't have that problem. Is kernel of centos 7 too old to ceph?
[15:37] * dmanchad (~dmanchad@nat-pool-bos-t.redhat.com) has joined #ceph
[15:38] * ngoswami__ (~ngoswami@1.39.85.11) Quit (Ping timeout: 480 seconds)
[15:40] * jclm (~jclm@72.143.50.126) Quit (Ping timeout: 480 seconds)
[15:42] * mps (~PierreW@6AGAABOKT.tor-irc.dnsbl.oftc.net) Quit ()
[15:42] * redbeast12 (~ChauffeR@109.201.133.100) has joined #ceph
[15:45] * overclk (~quassel@117.202.99.110) has joined #ceph
[15:46] * kefu_ (~kefu@183.193.162.205) has joined #ceph
[15:47] * yanzheng (~zhyan@125.70.21.216) Quit (Quit: This computer has gone to sleep)
[15:48] * overclk_ (~quassel@117.202.97.200) Quit (Ping timeout: 480 seconds)
[15:49] * EinstCrazy (~EinstCraz@101.85.207.158) has joined #ceph
[15:51] * karnan (~karnan@106.51.142.65) has joined #ceph
[15:51] * kefu (~kefu@183.193.162.205) Quit (Ping timeout: 480 seconds)
[15:52] * csoukup (~csoukup@159.140.254.107) has joined #ceph
[15:55] * kefu_ is now known as kefu
[15:56] * shaunm (~shaunm@nat-pool-rdu-u.redhat.com) has joined #ceph
[16:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[16:01] * swami1 (~swami@49.32.0.40) Quit (Quit: Leaving.)
[16:01] <wateringcan> any ceph developers here?
[16:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[16:01] <wateringcan> would love to get an update on http://tracker.ceph.com/issues/5900 :-/
[16:04] * Bj_o_rn (~CoZmicShR@76GAAE224.tor-irc.dnsbl.oftc.net) Quit ()
[16:12] * redbeast12 (~ChauffeR@76GAAE23F.tor-irc.dnsbl.oftc.net) Quit ()
[16:12] * Yopi (~Linkshot@static-ip-85-25-103-119.inaddr.ip-pool.com) has joined #ceph
[16:13] <Aeso> Is there any documentation available for setting up Ceph and LIO for HA iSCSI? Or anyone using iSCSI in production willing to point me in the right direction?
[16:13] * yanzheng (~zhyan@125.70.21.216) has joined #ceph
[16:13] * billwebb (~billwebb@50-203-47-138-static.hfc.comcastbusiness.net) Quit (Quit: billwebb)
[16:13] * cholcombe (~chris@12.39.178.125) has joined #ceph
[16:15] * billwebb (~billwebb@50-203-47-138-static.hfc.comcastbusiness.net) has joined #ceph
[16:19] * dan__ (~Daniel@2a00:1ee0:3:1337:c179:26e9:7480:4d2d) has joined #ceph
[16:19] * DanFoster (~Daniel@85.255.233.90) Quit (Read error: Connection reset by peer)
[16:19] * xarses (~xarses@c-73-202-191-48.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[16:22] * wwdillingham (~LobsterRo@140.247.242.44) has joined #ceph
[16:24] * alram (~alram@64.134.221.235) has joined #ceph
[16:24] * nwf (~nwf@00018577.user.oftc.net) Quit (Ping timeout: 480 seconds)
[16:25] * nwf (~nwf@00018577.user.oftc.net) has joined #ceph
[16:28] * qman__ (~rohroh@2600:3c00::f03c:91ff:fe69:92af) has joined #ceph
[16:28] * evilrob (~evilrob@2600:3c00::f03c:91ff:fedf:1d3d) Quit (Ping timeout: 480 seconds)
[16:29] * wushudoin (~wushudoin@2601:646:8202:5ed0:2ab2:bdff:fe0b:a6ee) has joined #ceph
[16:29] * harbie (~notroot@2a01:4f8:211:2344:0:dead:beef:1) Quit (Ping timeout: 480 seconds)
[16:29] * Larsen_ (~andreas@2001:67c:578:2::15) has joined #ceph
[16:29] * sudocat (~dibarra@2602:306:8bc7:4c50:6d64:ff65:7929:6baa) Quit (Ping timeout: 480 seconds)
[16:29] * harbie (~notroot@2a01:4f8:211:2344:0:dead:beef:1) has joined #ceph
[16:29] * motk_ (~motk@2600:3c00::f03c:91ff:fe98:51ee) has joined #ceph
[16:30] * ElNounch (sid150478@id-150478.ealing.irccloud.com) Quit (Ping timeout: 480 seconds)
[16:30] * JohnPreston78 (sid31393@id-31393.ealing.irccloud.com) Quit (Ping timeout: 480 seconds)
[16:30] * JohnPreston78 (sid31393@id-31393.ealing.irccloud.com) has joined #ceph
[16:31] * jgornick (~jgornick@2600:3c00::f03c:91ff:fedf:72b4) Quit (Ping timeout: 480 seconds)
[16:31] * nathani (~nathani@2607:f2f8:ac88::) Quit (Ping timeout: 480 seconds)
[16:31] * ElNounch (sid150478@id-150478.ealing.irccloud.com) has joined #ceph
[16:31] * motk (~motk@2600:3c00::f03c:91ff:fe98:51ee) Quit (Ping timeout: 480 seconds)
[16:31] * pasties (~pasties@00021c52.user.oftc.net) Quit (Ping timeout: 480 seconds)
[16:32] * qman (~rohroh@2600:3c00::f03c:91ff:fe69:92af) Quit (Ping timeout: 480 seconds)
[16:32] * Larsen (~andreas@2001:67c:578:2::15) Quit (Ping timeout: 480 seconds)
[16:32] * fdmanana (~fdmanana@2001:8a0:6e0c:6601:8ae:4653:621a:dc3a) Quit (Ping timeout: 480 seconds)
[16:33] * zack_dolby (~textual@p845d32.tokynt01.ap.so-net.ne.jp) has joined #ceph
[16:33] * alram (~alram@64.134.221.235) Quit (Quit: leaving)
[16:34] * lobstar (~sardonyx@62.102.148.67) has joined #ceph
[16:34] * xarses (~xarses@64.124.158.100) has joined #ceph
[16:35] * yanzheng (~zhyan@125.70.21.216) Quit (Quit: This computer has gone to sleep)
[16:36] * yanzheng (~zhyan@125.70.21.216) has joined #ceph
[16:37] * scuttle|afk is now known as scuttlemonkey
[16:38] * ngoswami_ (~ngoswami@1.39.85.11) Quit (Ping timeout: 480 seconds)
[16:39] * mattbenjamin (~mbenjamin@aa2.linuxbox.com) has joined #ceph
[16:40] * nathani (~nathani@2607:f2f8:ac88::) has joined #ceph
[16:42] * Yopi (~Linkshot@4MJAAEO9F.tor-irc.dnsbl.oftc.net) Quit ()
[16:42] * oracular (~BillyBobJ@207.244.70.35) has joined #ceph
[16:42] * billwebb (~billwebb@50-203-47-138-static.hfc.comcastbusiness.net) Quit (Quit: billwebb)
[16:43] * zack_dolby (~textual@p845d32.tokynt01.ap.so-net.ne.jp) Quit (Quit: Textual IRC Client: www.textualapp.com)
[16:44] * fdmanana (~fdmanana@2001:8a0:6e0c:6601:8ae:4653:621a:dc3a) has joined #ceph
[16:44] * yanzheng (~zhyan@125.70.21.216) Quit (Quit: This computer has gone to sleep)
[16:45] * alkaid (~alkaid@128.199.95.148) Quit (Quit: Leaving)
[16:47] * billwebb (~billwebb@50-203-47-138-static.hfc.comcastbusiness.net) has joined #ceph
[16:48] * MentalRay (~MentalRay@MTRLPQ42-1176054809.sdsl.bell.ca) has joined #ceph
[16:48] * deepthi (~deepthi@106.206.145.25) Quit (Quit: Leaving)
[16:50] * atg (~atg@10.127.254.xxx) Quit (Ping timeout: 480 seconds)
[16:51] * atg (~atg@10.127.254.xxx) has joined #ceph
[16:57] <Walex> while volunteer help is often available, for people who want actual support with issue updates etc. for production use this page may be relevant: https://access.redhat.com/products/red-hat-ceph-storage/
[16:57] * davidzlap (~Adium@2605:e000:1313:8003:8d37:d341:e620:5591) has joined #ceph
[16:58] <Walex> http://ceph.com/help/professional/
[16:58] <Walex> http://ceph.com/help/
[16:59] * linuxkidd (~linuxkidd@241.sub-70-210-192.myvzw.com) has joined #ceph
[16:59] * branto (~branto@178.253.163.131) Quit (Quit: Leaving.)
[17:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[17:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[17:02] * squizzi (~squizzi@nat-pool-rdu-t.redhat.com) has joined #ceph
[17:04] * lobstar (~sardonyx@4MJAAEPAM.tor-irc.dnsbl.oftc.net) Quit ()
[17:04] * analbeard (~shw@support.memset.com) Quit (Quit: Leaving.)
[17:06] * alram (~alram@192.41.52.12) has joined #ceph
[17:06] * vata1 (~vata@207.96.182.162) has joined #ceph
[17:08] * newbie (~kvirc@host217-114-156-249.pppoe.mark-itt.net) has joined #ceph
[17:12] * oracular (~BillyBobJ@7V7AAEB9W.tor-irc.dnsbl.oftc.net) Quit ()
[17:12] * Sliker (~Kidlvr@tor-exit-4.all.de) has joined #ceph
[17:16] * Sliker (~Kidlvr@7V7AAECAQ.tor-irc.dnsbl.oftc.net) Quit (Remote host closed the connection)
[17:17] * xarses (~xarses@64.124.158.100) Quit (Remote host closed the connection)
[17:17] * Rehevkor (~AGaW@4MJAAEPDC.tor-irc.dnsbl.oftc.net) has joined #ceph
[17:19] * huangjun (~kvirc@117.152.74.203) Quit (Ping timeout: 480 seconds)
[17:21] * sudocat (~dibarra@192.185.1.20) has joined #ceph
[17:23] * lcurtis_ (~lcurtis@47.19.105.250) has joined #ceph
[17:24] * atheism (~atheism@106.38.140.252) Quit (Ping timeout: 480 seconds)
[17:29] * dougf (~dougf@96-38-99-179.dhcp.jcsn.tn.charter.com) Quit (Ping timeout: 480 seconds)
[17:30] * dougf (~dougf@96-38-99-179.dhcp.jcsn.tn.charter.com) has joined #ceph
[17:32] * xarses (~xarses@64.124.158.100) has joined #ceph
[17:34] * jgornick (~jgornick@2600:3c00::f03c:91ff:fedf:72b4) has joined #ceph
[17:34] * DV (~veillard@2001:41d0:a:f29f::1) Quit (Remote host closed the connection)
[17:35] * evilrob (~evilrob@2600:3c00::f03c:91ff:fedf:1d3d) has joined #ceph
[17:35] <mtb`> Anyone running an erasure coded cluster, and using radosgw that can run a test?
[17:36] * shyu (~shyu@111.201.69.237) Quit (Ping timeout: 480 seconds)
[17:36] * DV (~veillard@2001:41d0:a:f29f::1) has joined #ceph
[17:37] * bara (~bara@nat-pool-brq-t.redhat.com) Quit (Ping timeout: 480 seconds)
[17:45] * neurodrone_ (~neurodron@pool-100-35-225-168.nwrknj.fios.verizon.net) has joined #ceph
[17:46] <Walex> mtb`: in a few weeks... :-)
[17:46] <Walex> mtb`: probably... :-)
[17:46] <Walex> mtb`: as a curiosity, what kind of test?
[17:47] * Rehevkor (~AGaW@4MJAAEPDC.tor-irc.dnsbl.oftc.net) Quit ()
[17:47] * Wijk (~Throlkim@orion.enn.lu) has joined #ceph
[17:47] <mtb`> so i think we found a situation where objects that are uploaded with specific sizes are not retrievable
[17:47] <mtb`> i've tested against 7 of my own clusters, i just wanted a non-me example
[17:47] <titzer> raarts: your two osds, are they on the same node/server?
[17:47] <Walex> mtb`: that's interesting to know, what kind of sizes?
[17:48] * blizzow (~jburns@50.243.148.102) has joined #ceph
[17:49] <mtb`> for me? 4.5MiB and every 4MiB there after
[17:49] <mtb`> minus a small buffer
[17:50] <mtb`> it also appears to affect different erasure code profiles differently
[17:50] * nwf (~nwf@00018577.user.oftc.net) Quit (Quit: WeeChat 1.4)
[17:52] * kefu (~kefu@183.193.162.205) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[17:53] * kefu (~kefu@183.193.162.205) has joined #ceph
[17:53] * ircuser-1 (~Johnny@158.183-62-69.ftth.swbr.surewest.net) Quit (Quit: because)
[17:54] * vikhyat (~vumrao@123.252.242.58) Quit (Quit: Leaving)
[17:57] * Concubidated (~cube@c-50-173-245-118.hsd1.ca.comcast.net) has joined #ceph
[17:57] * Concubidated (~cube@c-50-173-245-118.hsd1.ca.comcast.net) Quit ()
[17:58] * dan__ (~Daniel@2a00:1ee0:3:1337:c179:26e9:7480:4d2d) Quit (Quit: Leaving)
[17:59] * kefu (~kefu@183.193.162.205) Quit (Max SendQ exceeded)
[18:00] * kefu (~kefu@183.193.162.205) has joined #ceph
[18:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[18:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[18:01] * rraja (~rraja@121.244.87.117) Quit (Quit: Leaving)
[18:01] * Hemanth (~hkumar_@121.244.87.117) Quit (Ping timeout: 480 seconds)
[18:04] * jclm (~jclm@72.143.50.126) has joined #ceph
[18:04] * rakesh_ (~rakesh@121.244.87.117) Quit (Ping timeout: 480 seconds)
[18:05] * dack (~darrelle@gateway.ola.bc.ca) has joined #ceph
[18:07] <dack> I get this when trying to do rbd map (CentOS 7, jewel):
[18:07] <dack> rbd: sysfs write failed
[18:07] <dack> rbd: map failed: (6) No such device or address
[18:07] <dack> Any idea why? I'm pretty sure this worked fine on infernalis
[18:08] <dack> Nothing in dmesg, tried kernel 3.10, 4.4.0, and 4.5.2. Same results on all.
[18:09] <wwdillingham> dack: rbd kernel driver does not work with the new features enabled by default in jewel. I believe the fix is to use the legacy features with new rbd images
[18:09] <wwdillingham> rbd_default_features=1 in your conf
[18:09] <wwdillingham> which only enables layering
[18:09] <dack> ah, ok! that would explain it
[18:10] <dack> thanks
[18:10] <dack> what's the state of rbd-nbd?
[18:10] <dack> last I looked there were some bugs
[18:11] * wwdillingham has never used rbd-nbd
[18:11] <dack> ok, thanks
[18:11] * jclm1 (~jclm@72.143.50.126) Quit (Ping timeout: 480 seconds)
[18:15] <dack> wwdillingham: works perfectly after disabling those features, thanks again!
[18:16] <wwdillingham> dack: sure thing, hit that issue myself last week
[18:17] * Wijk (~Throlkim@7V7AAECBO.tor-irc.dnsbl.oftc.net) Quit ()
[18:17] * raindog (~spidu_@static-ip-85-25-103-119.inaddr.ip-pool.com) has joined #ceph
[18:27] * jcsp (~jspray@82-71-16-249.dsl.in-addr.zen.co.uk) Quit (Ping timeout: 480 seconds)
[18:27] * jermudgeon (~jhaustin@gw1.ttp.biz.whitestone.link) has joined #ceph
[18:29] * rraja (~rraja@121.244.87.117) has joined #ceph
[18:30] * rraja (~rraja@121.244.87.117) Quit ()
[18:31] * csoukup (~csoukup@159.140.254.107) Quit (Ping timeout: 480 seconds)
[18:32] * sugoruyo (~georgev@paarthurnax.esc.rl.ac.uk) Quit (Ping timeout: 480 seconds)
[18:37] * vasu (~vasu@c-73-231-60-138.hsd1.ca.comcast.net) has joined #ceph
[18:40] * sugoruyo (~georgev@paarthurnax.esc.rl.ac.uk) has joined #ceph
[18:43] * dack (~darrelle@gateway.ola.bc.ca) Quit (Quit: WeeChat 1.4)
[18:43] * linjan (~linjan@176.195.204.116) Quit (Ping timeout: 480 seconds)
[18:45] <titzer> raarts: I gotta go, but if you see this and both your osds are on the same node, look into editing your crushmap so that it will replicate across osds on the same server
[18:45] <titzer> adios
[18:46] <raarts> titzer: thanks
[18:47] * raindog (~spidu_@7V7AAECCN.tor-irc.dnsbl.oftc.net) Quit ()
[18:47] * Bonzaii (~danielsj@7V7AAECDD.tor-irc.dnsbl.oftc.net) has joined #ceph
[18:47] * jclm1 (~jclm@72.143.50.126) has joined #ceph
[18:47] * blizzow (~jburns@50.243.148.102) Quit (Ping timeout: 480 seconds)
[18:47] * i_m (~ivan.miro@deibp9eh1--blueice4n5.emea.ibm.com) Quit (Ping timeout: 480 seconds)
[18:49] * MentalRay_ (~MentalRay@office-mtl1-nat-146-218-70-69.gtcomm.net) has joined #ceph
[18:54] * jclm (~jclm@72.143.50.126) Quit (Ping timeout: 480 seconds)
[18:56] * MentalRay (~MentalRay@MTRLPQ42-1176054809.sdsl.bell.ca) Quit (Ping timeout: 480 seconds)
[18:56] * blizzow (~jburns@50.243.148.102) has joined #ceph
[18:57] * wwdillingham (~LobsterRo@140.247.242.44) Quit (Quit: wwdillingham)
[18:58] * reed (~reed@75-101-54-18.dsl.static.fusionbroadband.com) has joined #ceph
[19:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[19:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[19:03] * alkaid (~alkaid@128.199.95.148) has joined #ceph
[19:05] * mtb` (~mtb`@157.130.171.46) Quit (Quit: Textual IRC Client: www.textualapp.com)
[19:05] * bniver (~bniver@nat-pool-bos-u.redhat.com) Quit (Remote host closed the connection)
[19:07] * mtb` (~mtb`@157.130.171.46) has joined #ceph
[19:10] * swami1 (~swami@27.7.165.109) has joined #ceph
[19:12] * karnan (~karnan@106.51.142.65) Quit (Remote host closed the connection)
[19:14] * rixon_ (~rixon@is.get-o.net) has joined #ceph
[19:17] * Bonzaii (~danielsj@7V7AAECDD.tor-irc.dnsbl.oftc.net) Quit ()
[19:17] * brannmar (~darkid@hessel2.torservers.net) has joined #ceph
[19:18] * kefu (~kefu@183.193.162.205) Quit (Ping timeout: 480 seconds)
[19:22] * kefu (~kefu@114.92.122.74) has joined #ceph
[19:24] * kefu (~kefu@114.92.122.74) Quit ()
[19:31] * csoukup (~csoukup@159.140.254.97) has joined #ceph
[19:34] * Coe|work (~Dinnerbon@tollana.enn.lu) has joined #ceph
[19:37] * rakeshgm (~rakesh@106.51.26.7) has joined #ceph
[19:38] * cholcombe (~chris@12.39.178.125) Quit (Ping timeout: 480 seconds)
[19:46] * sage__ (~quassel@pool-173-76-103-210.bstnma.fios.verizon.net) Quit (Quit: http://quassel-irc.org - Chat comfortably. Anywhere.)
[19:46] * sage__ (~quassel@pool-173-76-103-210.bstnma.fios.verizon.net) has joined #ceph
[19:46] * MentalRay_ (~MentalRay@office-mtl1-nat-146-218-70-69.gtcomm.net) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[19:47] * brannmar (~darkid@06SAAB35Q.tor-irc.dnsbl.oftc.net) Quit ()
[19:47] * ulterior (~Knuckx@6AGAABOWZ.tor-irc.dnsbl.oftc.net) has joined #ceph
[19:48] * MentalRay (~MentalRay@office-mtl1-nat-146-218-70-69.gtcomm.net) has joined #ceph
[19:49] * m0zes (~mozes@ns1.beocat.ksu.edu) Quit (Ping timeout: 480 seconds)
[19:51] * swami1 (~swami@27.7.165.109) Quit (Quit: Leaving.)
[19:53] * Hemanth (~hkumar_@103.228.221.168) has joined #ceph
[19:54] * rakeshgm (~rakesh@106.51.26.7) Quit (Quit: Leaving)
[19:54] * alkaid (~alkaid@128.199.95.148) Quit (Quit: Leaving)
[19:54] * kefu (~kefu@107.191.53.152) has joined #ceph
[19:57] * jclm (~jclm@72.143.50.126) has joined #ceph
[19:58] * darrelle (~darrelle@gateway.ola.bc.ca) has joined #ceph
[19:59] * jermudgeon (~jhaustin@gw1.ttp.biz.whitestone.link) Quit (Quit: jermudgeon)
[19:59] <darrelle> With btrfs and parallel journal, when is the write acknowledged? Is it after either journal or osd is finished writing?
[20:00] * wwdillingham (~LobsterRo@140.247.242.44) has joined #ceph
[20:00] <wwdillingham> when you do an rbd export and use an image-spec, is it going to export a file at a point in time conistent state (maybe does a temporary snapshot of sorts, exports that and immediately removes it) or would one only use rbd export against a snap-spec if they wanted to export a running vm to file. (I am attempting to script out a backup process that involves rbd exporting and would prefer not to have to include the
[20:00] <wwdillingham> logic of making a snap, exporting it and then removing the snap)
[20:00] * kawa2014 (~kawa@89.184.114.246) Quit (Quit: Leaving)
[20:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[20:01] * kefu (~kefu@107.191.53.152) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[20:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[20:03] * jclm1 (~jclm@72.143.50.126) Quit (Ping timeout: 480 seconds)
[20:04] * jcsp (~jspray@82-71-16-249.dsl.in-addr.zen.co.uk) has joined #ceph
[20:04] * Coe|work (~Dinnerbon@4MJAAEPKD.tor-irc.dnsbl.oftc.net) Quit ()
[20:08] <jdillaman> wwdillingham: no -- you should export from a snapshot to be consistent if you have active IO on the iamge
[20:09] * Concubidated (~cube@c-50-173-245-118.hsd1.ca.comcast.net) has joined #ceph
[20:09] <wwdillingham> jdillaman: okay, I will do that. thanks
[20:09] <jdillaman> np
[20:12] * stiopa (~stiopa@cpc73832-dals21-2-0-cust453.20-2.cable.virginm.net) has joined #ceph
[20:14] * jermudgeon (~jhaustin@gw1.ttp.biz.whitestone.link) has joined #ceph
[20:14] * billwebb (~billwebb@50-203-47-138-static.hfc.comcastbusiness.net) Quit (Ping timeout: 480 seconds)
[20:17] * ulterior (~Knuckx@6AGAABOWZ.tor-irc.dnsbl.oftc.net) Quit ()
[20:18] * sudocat (~dibarra@192.185.1.20) Quit (Ping timeout: 480 seconds)
[20:21] * m0zes (~mozes@ns1.beocat.ksu.edu) has joined #ceph
[20:25] * bniver (~bniver@71-9-144-29.static.oxfr.ma.charter.com) has joined #ceph
[20:25] * jermudgeon (~jhaustin@gw1.ttp.biz.whitestone.link) Quit (Read error: Connection reset by peer)
[20:25] * jermudgeon (~jhaustin@gw1.ttp.biz.whitestone.link) has joined #ceph
[20:27] * Discovery (~Discovery@178.239.49.69) has joined #ceph
[20:31] * mhack (~mhack@66-168-117-78.dhcp.oxfr.ma.charter.com) has joined #ceph
[20:33] * sudocat (~dibarra@192.185.1.20) has joined #ceph
[20:34] * jermudgeon (~jhaustin@gw1.ttp.biz.whitestone.link) Quit (Read error: Connection reset by peer)
[20:38] * jermudgeon (~jhaustin@gw1.ttp.biz.whitestone.link) has joined #ceph
[20:39] * Pieman (~starcoder@81.89.0.200) has joined #ceph
[20:46] * sudocat (~dibarra@192.185.1.20) Quit (Quit: Leaving.)
[20:46] * sudocat (~dibarra@192.185.1.20) has joined #ceph
[20:46] * owasserm (~owasserm@87.71.34.43) Quit (Ping timeout: 480 seconds)
[20:47] * i_m (~ivan.miro@nat-5-carp.hcn-strela.ru) has joined #ceph
[20:51] * jcsp (~jspray@82-71-16-249.dsl.in-addr.zen.co.uk) Quit (Ping timeout: 480 seconds)
[21:00] * cholcombe (~chris@12.39.178.119) has joined #ceph
[21:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[21:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[21:04] * khyron (~khyron@fixed-190-159-187-190-159-75.iusacell.net) Quit (Quit: The computer fell asleep)
[21:04] * haplo37 (~haplo37@199.91.185.156) has joined #ceph
[21:04] * khyron (~khyron@fixed-190-159-187-190-159-75.iusacell.net) has joined #ceph
[21:05] * wushudoin (~wushudoin@2601:646:8202:5ed0:2ab2:bdff:fe0b:a6ee) Quit (Ping timeout: 480 seconds)
[21:09] * Pieman (~starcoder@4MJAAEPNH.tor-irc.dnsbl.oftc.net) Quit ()
[21:12] * khyron (~khyron@fixed-190-159-187-190-159-75.iusacell.net) Quit (Ping timeout: 480 seconds)
[21:14] * Concubidated (~cube@c-50-173-245-118.hsd1.ca.comcast.net) Quit (Quit: Leaving.)
[21:17] * Shesh (~qable@ns316491.ip-37-187-129.eu) has joined #ceph
[21:18] * Hemanth (~hkumar_@103.228.221.168) Quit (Ping timeout: 480 seconds)
[21:20] * scuttlemonkey is now known as scuttle|afk
[21:24] * overclk (~quassel@117.202.99.110) Quit (Remote host closed the connection)
[21:30] * jermudgeon (~jhaustin@gw1.ttp.biz.whitestone.link) Quit (Read error: Connection reset by peer)
[21:33] * zaitcev (~zaitcev@c-50-130-189-82.hsd1.nm.comcast.net) has joined #ceph
[21:34] * jcsp (~jspray@82-71-16-249.dsl.in-addr.zen.co.uk) has joined #ceph
[21:35] * jermudgeon (~jhaustin@gw1.ttp.biz.whitestone.link) has joined #ceph
[21:36] * Hemanth (~hkumar_@103.228.221.168) has joined #ceph
[21:39] * FNugget (~CobraKhan@tor-exit.dhalgren.org) has joined #ceph
[21:39] * cholcombe (~chris@12.39.178.119) Quit (Ping timeout: 480 seconds)
[21:42] * mykola (~Mikolaj@91.245.73.44) has joined #ceph
[21:43] * cholcombe (~chris@12.39.178.119) has joined #ceph
[21:46] * wushudoin (~wushudoin@38.99.12.237) has joined #ceph
[21:47] * Shesh (~qable@4MJAAEPO4.tor-irc.dnsbl.oftc.net) Quit ()
[21:51] * rendar (~I@82.61.125.242) Quit (Ping timeout: 480 seconds)
[21:51] * qable (~KapiteinK@185.100.86.69) has joined #ceph
[21:53] * shaunm (~shaunm@nat-pool-rdu-u.redhat.com) Quit (Ping timeout: 480 seconds)
[21:54] * rendar (~I@82.61.125.242) has joined #ceph
[22:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[22:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[22:03] * jcsp (~jspray@82-71-16-249.dsl.in-addr.zen.co.uk) Quit (Ping timeout: 480 seconds)
[22:09] * FNugget (~CobraKhan@06SAAB4AG.tor-irc.dnsbl.oftc.net) Quit ()
[22:09] * maku (~Dragonsha@tor.exit-no.de) has joined #ceph
[22:10] * DV (~veillard@2001:41d0:a:f29f::1) Quit (Remote host closed the connection)
[22:11] * DV (~veillard@2001:41d0:a:f29f::1) has joined #ceph
[22:15] * jclm (~jclm@72.143.50.126) Quit (Quit: Leaving.)
[22:17] * cholcombe (~chris@12.39.178.119) Quit (Ping timeout: 480 seconds)
[22:18] * jermudgeon (~jhaustin@gw1.ttp.biz.whitestone.link) Quit (Read error: Connection reset by peer)
[22:19] <herrsergio> hello
[22:20] * shaunm (~shaunm@rrcs-70-60-101-195.midsouth.biz.rr.com) has joined #ceph
[22:21] * qable (~KapiteinK@06SAAB4AW.tor-irc.dnsbl.oftc.net) Quit ()
[22:21] * narthollis (~brannmar@exit.tor.uwaterloo.ca) has joined #ceph
[22:22] * georgem (~Adium@206.108.127.16) Quit (Quit: Leaving.)
[22:23] * jermudgeon (~jhaustin@gw1.ttp.biz.whitestone.link) has joined #ceph
[22:26] * newbie (~kvirc@host217-114-156-249.pppoe.mark-itt.net) Quit (Ping timeout: 480 seconds)
[22:29] * masteroman (~ivan@78-1-229-131.adsl.net.t-com.hr) has joined #ceph
[22:30] * shaunm (~shaunm@rrcs-70-60-101-195.midsouth.biz.rr.com) Quit (Ping timeout: 480 seconds)
[22:33] * mattbenjamin (~mbenjamin@aa2.linuxbox.com) Quit (Ping timeout: 480 seconds)
[22:34] * ivancich (~ivancich@aa2.linuxbox.com) Quit (Ping timeout: 480 seconds)
[22:37] * Wahmed (~wahmed@206.174.203.195) has joined #ceph
[22:38] * georgem (~Adium@24.114.64.162) has joined #ceph
[22:38] * georgem (~Adium@24.114.64.162) Quit ()
[22:38] * georgem (~Adium@206.108.127.16) has joined #ceph
[22:39] * maku (~Dragonsha@6AGAABO1Y.tor-irc.dnsbl.oftc.net) Quit ()
[22:39] <Wahmed> Hello, i have a Ceph cluster with 6 nodes. Recently i had a power outage. After restarting everything it seems like i have 3 pg incomplete error. All OP requests are being blocked. I have pin pointed the PGs and deleted them. Tried to force create after that and restarted all OSDs. But it keeps showing 3 pg incomplete error. How can i tell the cluster to forget about the PGs completely ?
[22:39] * vata (~vata@cable-21.246.173-197.electronicbox.net) Quit (Ping timeout: 480 seconds)
[22:42] * Qu310 (~qnet@qu310.qnet.net.au) Quit (Read error: Connection reset by peer)
[22:42] * Qu310 (~qnet@qu310.qnet.net.au) has joined #ceph
[22:43] * alram_ (~alram@192.41.52.12) has joined #ceph
[22:44] * mykola (~Mikolaj@91.245.73.44) Quit (Quit: away)
[22:46] * boredatwork (~overonthe@199.68.193.54) has joined #ceph
[22:46] * offer (~shishi@atlantic480.us.unmetered.com) has joined #ceph
[22:46] * jclm (~jclm@marriott-hotel-ottawa-yowmc.sites.intello.com) has joined #ceph
[22:47] <xcezzz> ceph pg x.Y mark_unfound_lost delete
[22:47] <xcezzz> but you probably could have fixed it without deleting them btw
[22:48] * alram (~alram@192.41.52.12) Quit (Read error: No route to host)
[22:48] <Wahmed> i tried unfound_lost but it said there are no unfound object. that was before deleting them.
[22:48] <Wahmed> i deleted them as last resort after All else failed
[22:48] <xcezzz> what is the pool replica size
[22:48] <Wahmed> also tried repair, scrub, deep-scrub and nothing wotrked
[22:49] <Wahmed> rep size 3, min size 1
[22:49] <xcezzz> u dont have any other unclean pgs?
[22:49] * vata (~vata@cable-21.246.173-197.electronicbox.net) has joined #ceph
[22:49] <Wahmed> no
[22:49] <Wahmed> just 3 Incomplete
[22:49] * rburkholder (~overonthe@199.68.193.62) Quit (Ping timeout: 480 seconds)
[22:50] <xcezzz> if you do a pg dump and the pgs that are bad??? does it show any acting/primary OSDs for them?
[22:51] <xcezzz> also??? on any of the acting/primary OSDs do you see any of the pgs that are missing??? did you remove them off all OSDs that were acting/primary
[22:51] * narthollis (~brannmar@4MJAAEPR7.tor-irc.dnsbl.oftc.net) Quit ()
[22:53] * cholcombe (~chris@12.39.178.125) has joined #ceph
[22:53] <xcezzz> ceph pg force_create_pg <pgid> #only if you actually wiped them everywhere
[22:54] <Wahmed> pg dump shows active/primary for them 3 OSDs, i have removed the PG from All OSDs one by one, restarted OSD then did force_create
[22:54] <Wahmed> it showed creating for very long time then went back to Incomplete
[22:55] <xcezzz> you bumped min_size down to 1 im assuming as one of the first things to try and fix
[22:55] * brad_mssw (~brad@66.129.88.50) Quit (Quit: Leaving)
[22:56] <Wahmed> it was not bumped. When i created the cluster 1 year ago i started with min size 1
[22:56] * jermudgeon (~jhaustin@gw1.ttp.biz.whitestone.link) Quit (Read error: Connection reset by peer)
[22:56] <xcezzz> owies
[22:56] <xcezzz> was there any data on the pool with the inc pgs?
[22:57] <Wahmed> yes
[22:57] <xcezzz> oh dear??? but you do realize if you deleted the pg of EVERY osd it was on??? your kinda in a bad spot...
[22:58] <Wahmed> U mean loss of data wise? yes
[22:58] <Wahmed> right now i just want to leave these 3 PGs behind and move on
[22:58] <xcezzz> well??? nuke the pool
[22:58] <xcezzz> but i really dont know the best option honestly
[22:59] <xcezzz> so there???s this
[23:00] <Wahmed> but not all data in the pool are bad. Only small portion of the Virtual machine image seems to be affected in the pool
[23:00] <xcezzz> hmm
[23:00] <xcezzz> well here???s a dude that sounds like he did something similar
[23:00] <xcezzz> http://www.spinics.net/lists/ceph-users/msg04010.html
[23:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) Quit (Remote host closed the connection)
[23:01] <xcezzz> but you may be too far gone to try this one
[23:01] <xcezzz> https://ceph.com/community/incomplete-pgs-oh-my/
[23:01] * haomaiwang (~haomaiwan@li401-170.members.linode.com) has joined #ceph
[23:01] * jermudgeon (~jhaustin@gw1.ttp.biz.whitestone.link) has joined #ceph
[23:01] * raarts (~Adium@82-171-243-109.ip.telfort.nl) Quit (Quit: Leaving.)
[23:01] <Wahmed> is there no way to tell Ceph to forget about those 3 PGs?
[23:02] * raarts (~Adium@82-171-243-109.ip.telfort.nl) has joined #ceph
[23:02] <xcezzz> well the mark lost/unfound should do that??? but the problem is your rbd image isn???t going to like that
[23:02] <xcezzz> and any image that may have ended up striped on it
[23:02] * haplo37 (~haplo37@199.91.185.156) Quit (Ping timeout: 480 seconds)
[23:04] <xcezzz> future note??? you can ???hide??? pgs on an osd by moving them to a hidden dir??? never delete them unless your 100% certain
[23:07] <Wahmed> lesson learned. i did that for 1 PG though.
[23:08] <Wahmed> i still have the content for the first incomplete PG and it is in one of the OSDs directory. but that also not getting fixed
[23:13] * offer (~shishi@6AGAABO3F.tor-irc.dnsbl.oftc.net) Quit ()
[23:13] * K3NT1S_aw (~drdanick@hessel0.torservers.net) has joined #ceph
[23:13] * georgem (~Adium@206.108.127.16) Quit (Read error: Connection reset by peer)
[23:14] * mattbenjamin (~mbenjamin@aa2.linuxbox.com) has joined #ceph
[23:16] * georgem (~Adium@24.114.71.201) has joined #ceph
[23:16] * cholcombe (~chris@12.39.178.125) Quit (Ping timeout: 480 seconds)
[23:19] * Wahmed (~wahmed@206.174.203.195) Quit (Quit: Nettalk6 - www.ntalk.de)
[23:21] * ivancich (~ivancich@aa2.linuxbox.com) has joined #ceph
[23:21] * csoukup (~csoukup@159.140.254.97) Quit (Ping timeout: 480 seconds)
[23:21] * Crisco (~sixofour@06SAAB4EW.tor-irc.dnsbl.oftc.net) has joined #ceph
[23:23] * bniver (~bniver@71-9-144-29.static.oxfr.ma.charter.com) Quit (Remote host closed the connection)
[23:28] * wushudoin (~wushudoin@38.99.12.237) Quit (Ping timeout: 480 seconds)
[23:29] * drnexus (~cmorandin@boc06-4-78-216-15-170.fbx.proxad.net) has joined #ceph
[23:32] * dneary (~dneary@nat-pool-bos-u.redhat.com) Quit (Ping timeout: 480 seconds)
[23:34] * cmorandin (~cmorandin@boc06-4-78-216-15-170.fbx.proxad.net) has joined #ceph
[23:37] * cholcombe (~chris@12.39.178.119) has joined #ceph
[23:38] * darrelle (~darrelle@gateway.ola.bc.ca) Quit (Quit: WeeChat 1.4)
[23:39] * georgem (~Adium@24.114.71.201) Quit (Read error: Connection reset by peer)
[23:43] * K3NT1S_aw (~drdanick@6AGAABO4Q.tor-irc.dnsbl.oftc.net) Quit ()
[23:43] * Hejt (~HoboPickl@6AGAABO5R.tor-irc.dnsbl.oftc.net) has joined #ceph
[23:44] * Wahmed (~wahmed@206.174.203.195) has joined #ceph
[23:45] * ivancich (~ivancich@aa2.linuxbox.com) Quit (Ping timeout: 480 seconds)
[23:51] * Crisco (~sixofour@06SAAB4EW.tor-irc.dnsbl.oftc.net) Quit ()
[23:51] * Frostshifter (~VampiricP@politkovskaja.torservers.net) has joined #ceph
[23:55] * jcsp (~jspray@82-71-16-249.dsl.in-addr.zen.co.uk) has joined #ceph
[23:56] * Racpatel (~Racpatel@2601:87:3:3601::6f15) Quit (Quit: Leaving)
[23:59] * bene2 (~bene@nat-pool-bos-t.redhat.com) has joined #ceph
[23:59] * squizzi (~squizzi@nat-pool-rdu-t.redhat.com) Quit (Ping timeout: 480 seconds)

These logs were automatically created by CephLogBot on irc.oftc.net using the Java IRC LogBot.