#ceph IRC Log

Index

IRC Log for 2015-06-04

Timestamps are in GMT/BST.

[0:00] * linuxkidd (~linuxkidd@63.79.89.17) Quit (Quit: Leaving)
[0:01] * evilrob00 (~evilrob00@cpe-72-179-3-209.austin.res.rr.com) Quit (Ping timeout: 480 seconds)
[0:02] * imjpr (~imjpr@thing2.it.uab.edu) Quit (Ping timeout: 480 seconds)
[0:02] * itsjpr (~imjpr@138.26.125.8) Quit (Ping timeout: 480 seconds)
[0:04] * valeech (~valeech@pool-72-86-37-215.clppva.fios.verizon.net) Quit (Quit: valeech)
[0:06] * yuastnav (~Coe|work@5NZAAC78D.tor-irc.dnsbl.oftc.net) Quit ()
[0:06] * mrapple (~basicxman@lumumba.torservers.net) has joined #ceph
[0:07] * midnightrunner (~midnightr@216.113.160.71) Quit (Remote host closed the connection)
[0:14] * midnightrunner (~midnightr@216.113.160.71) has joined #ceph
[0:15] * evilrob00 (~evilrob00@cpe-72-179-3-209.austin.res.rr.com) has joined #ceph
[0:15] * primechu_ (~primechuc@host-95-2-129.infobunker.com) Quit (Remote host closed the connection)
[0:16] * bandrus1 (~brian@172.sub-70-214-40.myvzw.com) has joined #ceph
[0:17] * bandrus (~brian@172.sub-70-214-40.myvzw.com) Quit (Quit: Leaving.)
[0:20] * primechuck (~primechuc@host-95-2-129.infobunker.com) has joined #ceph
[0:20] * primechuck (~primechuc@host-95-2-129.infobunker.com) Quit (Remote host closed the connection)
[0:20] * primechuck (~primechuc@host-95-2-129.infobunker.com) has joined #ceph
[0:23] * midnightrunner (~midnightr@216.113.160.71) Quit (Remote host closed the connection)
[0:28] * oro (~oro@84-72-20-79.dclient.hispeed.ch) Quit (Ping timeout: 480 seconds)
[0:30] * rlrevell (~leer@184.52.129.221) has joined #ceph
[0:31] * rlrevell (~leer@184.52.129.221) has left #ceph
[0:33] * doppelgrau (~doppelgra@pd956d116.dip0.t-ipconnect.de) Quit (Quit: doppelgrau)
[0:35] * midnight_ (~midnightr@216.113.160.71) has joined #ceph
[0:36] * mrapple (~basicxman@9S0AAAK0V.tor-irc.dnsbl.oftc.net) Quit ()
[0:36] * nih (~sardonyx@spftor1e1.privacyfoundation.ch) has joined #ceph
[0:40] * valeech (~valeech@pool-72-86-37-215.clppva.fios.verizon.net) has joined #ceph
[0:46] * valeech (~valeech@pool-72-86-37-215.clppva.fios.verizon.net) Quit (Quit: valeech)
[1:00] * moore (~moore@64.202.160.88) Quit (Remote host closed the connection)
[1:00] * alram (~alram@192.41.52.12) Quit (Quit: leaving)
[1:02] * valeech (~valeech@pool-72-86-37-215.clppva.fios.verizon.net) has joined #ceph
[1:02] * fsimonce (~simon@host253-71-dynamic.3-87-r.retail.telecomitalia.it) Quit (Quit: Coyote finally caught me)
[1:04] * stiopa (~stiopa@cpc73828-dals21-2-0-cust630.20-2.cable.virginm.net) Quit (Ping timeout: 480 seconds)
[1:05] * primechuck (~primechuc@host-95-2-129.infobunker.com) Quit (Remote host closed the connection)
[1:06] * nih (~sardonyx@5NZAAC8BR.tor-irc.dnsbl.oftc.net) Quit ()
[1:06] * Grimmer (~tritonx@72.52.91.30) has joined #ceph
[1:08] * valeech (~valeech@pool-72-86-37-215.clppva.fios.verizon.net) Quit (Quit: valeech)
[1:11] * oms101_ (~oms101@p20030057EA3C8900C6D987FFFE4339A1.dip0.t-ipconnect.de) Quit (Ping timeout: 480 seconds)
[1:18] * bandrus1 (~brian@172.sub-70-214-40.myvzw.com) Quit (Read error: Connection reset by peer)
[1:18] * bandrus (~brian@172.sub-70-214-40.myvzw.com) has joined #ceph
[1:18] * jclm (~jclm@211.177.245.165) Quit (Quit: Leaving.)
[1:19] * oms101_ (~oms101@p20030057EA3A1500C6D987FFFE4339A1.dip0.t-ipconnect.de) has joined #ceph
[1:21] * angdraug (~angdraug@12.164.168.117) Quit (Ping timeout: 480 seconds)
[1:24] * vata (~vata@cable-21.246.173-197.electronicbox.net) has joined #ceph
[1:33] * nwf (~nwf@00018577.user.oftc.net) Quit (Ping timeout: 480 seconds)
[1:33] * alram (~alram@64.134.221.151) has joined #ceph
[1:35] * yguang11 (~yguang11@nat-dip30-wl-d.cfw-a-gci.corp.yahoo.com) Quit (Remote host closed the connection)
[1:36] * Grimmer (~tritonx@9S0AAAK3W.tor-irc.dnsbl.oftc.net) Quit ()
[1:36] * Azerothian______ (~Moriarty@176.31.182.218) has joined #ceph
[1:44] * wushudoin_ (~wushudoin@38.140.108.2) Quit (Ping timeout: 480 seconds)
[1:50] * jclm (~jclm@118.130.198.164) has joined #ceph
[1:52] * dustinm` (~dustinm`@105.ip-167-114-152.net) Quit (Ping timeout: 480 seconds)
[1:55] * xarses (~andreww@12.164.168.117) Quit (Ping timeout: 480 seconds)
[1:57] * dustinm` (~dustinm`@2607:5300:100:200::160d) has joined #ceph
[1:57] * yguang11 (~yguang11@nat-dip30-wl-d.cfw-a-gci.corp.yahoo.com) has joined #ceph
[2:05] * yguang11 (~yguang11@nat-dip30-wl-d.cfw-a-gci.corp.yahoo.com) Quit (Ping timeout: 480 seconds)
[2:05] * yguang11 (~yguang11@nat-dip30-wl-d.cfw-a-gci.corp.yahoo.com) has joined #ceph
[2:06] * Azerothian______ (~Moriarty@5NZAAC8EG.tor-irc.dnsbl.oftc.net) Quit ()
[2:07] * OutOfNoWhere (~rpb@199.68.195.102) has joined #ceph
[2:07] * ircolle (~Adium@2601:1:a580:1735:c50c:9433:f79b:a4ab) Quit (Quit: Leaving.)
[2:09] * Gospod (~oftc-webi@cpe2-30-51.cable.triera.net) has joined #ceph
[2:10] * dneary (~dneary@pool-96-252-45-212.bstnma.fios.verizon.net) has joined #ceph
[2:11] <Gospod> Hello everyone. Me and my team are ready to dive into distributed file systems. We are kind of stuck with ceph and have some questions...
[2:11] * yguang11 (~yguang11@nat-dip30-wl-d.cfw-a-gci.corp.yahoo.com) Quit ()
[2:14] <Gospod> We know everything (especially I) there is to know about ZFS which we are currently using bug we need to go scale out for scalability reasons
[2:15] <Gospod> Main problem and question is data integrity (against bitrot) and if it can be achieved with nonECC OSD nodes?
[2:16] <Gospod> Anyone?
[2:20] * Concubidated (~Adium@irvine-dc.dreamhost.com) Quit (Quit: Leaving.)
[2:23] * Bosse (~bosse@rifter2.klykken.com) Quit (Ping timeout: 480 seconds)
[2:24] * xarses (~andreww@c-73-202-191-48.hsd1.ca.comcast.net) has joined #ceph
[2:24] <mongo> scrubs will capture most errors, if you keep a high enough replica count.
[2:24] * MACscr1 (~Adium@2601:d:c800:de3:84d0:16ca:4290:5c73) has joined #ceph
[2:25] <Gospod> Most but is it like zfs?
[2:26] * asalor (~asalor@0001ef37.user.oftc.net) Quit (Ping timeout: 480 seconds)
[2:26] * jgornick (~jgornick@2600:3c00::f03c:91ff:fedf:72b4) Quit (Ping timeout: 480 seconds)
[2:26] * asalor (~asalor@2a00:1028:96c1:4f6a:204:e2ff:fea1:64e6) has joined #ceph
[2:27] * debian112 (~bcolbert@24.126.201.64) Quit (Quit: Leaving.)
[2:27] * midnight_ (~midnightr@216.113.160.71) Quit (Remote host closed the connection)
[2:27] * nolan_ (~nolan@2001:470:1:41:a800:ff:fe3e:ad08) has joined #ceph
[2:27] * zaitcev (~zaitcev@2001:558:6001:10:61d7:f51f:def8:4b0f) Quit (Ping timeout: 480 seconds)
[2:27] * jdillaman (~jdillaman@pool-108-18-97-82.washdc.fios.verizon.net) Quit (Quit: jdillaman)
[2:27] * snerd_ (~motk@2600:3c00::f03c:91ff:fedb:2295) has joined #ceph
[2:27] <mongo> btrfs would help with most of that but it is less of an issue with replication than with raid style systems.
[2:28] * Bosse (~bosse@rifter2.klykken.com) has joined #ceph
[2:28] <Gospod> But btrfs needs ECC on OSD nodes right?
[2:29] * Tetard_ (~regnauld@x1.x0.dk) has joined #ceph
[2:30] * zaitcev (~zaitcev@2001:558:6001:10:61d7:f51f:def8:4b0f) has joined #ceph
[2:30] * chutz (~chutz@rygel.linuxfreak.ca) Quit (Ping timeout: 480 seconds)
[2:30] * snerd (~motk@2600:3c00::f03c:91ff:fedb:2295) Quit (Ping timeout: 480 seconds)
[2:30] * Tetard (~regnauld@x1.x0.dk) Quit (Read error: Connection reset by peer)
[2:30] * jwilkins (~jwilkins@2601:9:4580:f4c:ea2a:eaff:fe08:3f1d) Quit (Ping timeout: 480 seconds)
[2:30] * MACscr (~Adium@2601:d:c800:de3:95b8:1561:3be5:e845) Quit (Ping timeout: 480 seconds)
[2:30] * blahnana (~bman@2602:ffe8:200:1::6019:93b3) Quit (Ping timeout: 480 seconds)
[2:30] * nolan (~nolan@2001:470:1:41:a800:ff:fe3e:ad08) Quit (Ping timeout: 480 seconds)
[2:30] * nolan_ is now known as nolan
[2:30] * guerby (~guerby@ip165-ipv6.tetaneutral.net) Quit (Ping timeout: 480 seconds)
[2:30] * al (d@niel.cx) Quit (Ping timeout: 480 seconds)
[2:31] * jgornick (~jgornick@2600:3c00::f03c:91ff:fedf:72b4) has joined #ceph
[2:32] * blahnana (~bman@2602:ffe8:200:1::6019:93b3) has joined #ceph
[2:33] * Nacer (~Nacer@203-206-190-109.dsl.ovh.fr) Quit (Read error: Connection reset by peer)
[2:35] <mongo> depends on what you mean "needs"
[2:35] <Nats> this came up in the channel a while back, answer was ceph data is not checksummed at rest
[2:35] * ira (~ira@c-71-233-225-22.hsd1.ma.comcast.net) Quit (Quit: Leaving)
[2:36] * CorneliousJD|AtWork (~Silentkil@spftor4e1.privacyfoundation.ch) has joined #ceph
[2:36] * LeaChim (~LeaChim@host86-163-124-72.range86-163.btcentralplus.com) Quit (Ping timeout: 480 seconds)
[2:37] <Gospod> Mongo against bitrot
[2:38] * sankarshan (~sankarsha@183.87.39.242) Quit (Quit: Are you sure you want to quit this channel (Cancel/Ok) ?)
[2:38] * al (quassel@niel.cx) has joined #ceph
[2:38] <mongo> Nats: well a light scrub happens daily checking size and a deep scrub happens weekly with full testing of checksums.
[2:38] <Nats> yep
[2:38] <mongo> Gospod: the risk would be on the first write, if you have 3 copies on three phsyical hosts you should be mostly safe
[2:38] * chutz (~chutz@rygel.linuxfreak.ca) has joined #ceph
[2:39] <Nats> so comes down to whether you are prepared for it to be eventually correct
[2:39] <mongo> btrfs has similar checksumming as zfs
[2:39] <mongo> if you use xfs for backing...yes you may have problems.
[2:39] * guerby (~guerby@ip165-ipv6.tetaneutral.net) has joined #ceph
[2:40] * midnightrunner (~midnightr@216.113.160.71) has joined #ceph
[2:40] <Gospod> But btrfs on nonecc is safe?
[2:40] * lucas1 (~Thunderbi@218.76.52.64) has joined #ceph
[2:40] <mongo> like zfs btrfs also writes a checksum with each individual block of data and checks it on read
[2:40] <Nats> XFS is the only recommended FS for ceph production
[2:41] <mongo> Depends on what "safe" is for you.
[2:41] * jwilkins (~jwilkins@2601:9:4580:f4c:ea2a:eaff:fe08:3f1d) has joined #ceph
[2:42] <mongo> most ram is parity now. If data is that important it should be replicated multiple times.
[2:42] <Gospod> Against bitrot...
[2:43] <Gospod> If no eccram = not 100% sure right?
[2:43] <mongo> ecc ram does nothing for bitrot except on software errors.
[2:43] <mongo> no, parity ram will catch almost all of the same errors, it just won't have a way to recover
[2:44] <Gospod> Data comes in ram (gets bit flip) > write to disk
[2:44] <Gospod> How it does nothing?
[2:44] <mongo> Nats: I have been running several ceph clusters in production with btrfs for a few years now. Actually major kernel bugs caused data loss with XFS and ceph :)
[2:44] <mongo> that is not bitrot
[2:44] <mongo> as far as zfs would protect against
[2:45] <Nats> mongo, anecdotally you are one of the lucky ones
[2:45] <mongo> Nats, no it is quite calcuated. Obviouslly you can't be running your cluster on some ancient kernel.
[2:47] <Gospod> Is there any cluster FS as to what im trying to achieve?
[2:47] <mongo> The main advantage of ECC is what when an error does happen the system stays up, parity based systems may crash.
[2:47] * johanni (~johanni@173.226.103.101) Quit (Remote host closed the connection)
[2:48] * cholcombe (~chris@c-73-180-29-35.hsd1.or.comcast.net) Quit (Ping timeout: 480 seconds)
[2:49] <Gospod> And that data is 100% written as it was supposed to?
[2:49] <mongo> It does not mean that at all
[2:50] <Gospod> But u know what I mean?
[2:50] <mongo> A two bit error on ECC could go undetected
[2:50] <mongo> ECC means single bit errors can be corrected, that is all.
[2:51] * lx0 (~aoliva@lxo.user.oftc.net) has joined #ceph
[2:53] <mongo> If your data is that critical it is best to encode it to detect errors, but Ceph in this case is not way more reliable due to ECC. just slightly more reliable and the same is true with ZFS
[2:53] <mongo> the bit rot that zfs mostly protects against is random flipping of bits on the storage media.
[2:54] * johanni_ (~johanni@173.226.103.101) Quit (Ping timeout: 480 seconds)
[2:54] <Gospod> Yeah mongo
[2:55] <Gospod> Exactly that can it be achieved with 100% same confidence with ceph?
[2:55] <Gospod> Or any other?
[2:55] <mongo> It can not be achieved with 100% in any system.
[2:55] * lxo (~aoliva@lxo.user.oftc.net) Quit (Ping timeout: 480 seconds)
[2:59] * lxo (~aoliva@lxo.user.oftc.net) has joined #ceph
[3:01] <Gospod> Lets talk about checksumming then
[3:02] <Gospod> When a file is read does it check the checksum and retrieve the correct one in ceph?
[3:03] * lx0 (~aoliva@lxo.user.oftc.net) Quit (Ping timeout: 480 seconds)
[3:04] * bandrus (~brian@172.sub-70-214-40.myvzw.com) Quit (Quit: Leaving.)
[3:04] <Gospod> Where are checksums stored? On datanodes or can i force fix them all on a specific node?
[3:04] * alram (~alram@64.134.221.151) Quit (Quit: leaving)
[3:06] * CorneliousJD|AtWork (~Silentkil@9S0AAALEB.tor-irc.dnsbl.oftc.net) Quit ()
[3:06] * darkid (~darkid@tor-exit2-readme.puckey.org) has joined #ceph
[3:06] <Gospod> Mongo?
[3:08] * kefu (~kefu@114.92.116.93) has joined #ceph
[3:08] * primechuck (~primechuc@173-17-128-216.client.mchsi.com) has joined #ceph
[3:10] * CheKoLyN (~saguilar@13.4.15.143) has joined #ceph
[3:12] <Gospod> Anyone? :(
[3:15] * alram (~alram@64.134.221.151) has joined #ceph
[3:15] <Gospod> Would be nice to know if on Ceph checksums can be stored on a specific node and the underlying is ZFS on that node, problem solved
[3:19] * alram (~alram@64.134.221.151) Quit ()
[3:21] <kefu> Gospod: i don't think ceph supports zfs .
[3:23] * zack_dolby (~textual@pa3b3a1.tokynt01.ap.so-net.ne.jp) Quit (Quit: My MacBook has gone to sleep. ZZZzzz???)
[3:23] * zack_dolby (~textual@pa3b3a1.tokynt01.ap.so-net.ne.jp) has joined #ceph
[3:25] * Mika_c (~Mk@122.146.93.152) has joined #ceph
[3:25] * Mika_c (~Mk@122.146.93.152) Quit (Remote host closed the connection)
[3:25] * Mika_c (~Mk@122.146.93.152) has joined #ceph
[3:26] * midnightrunner (~midnightr@216.113.160.71) Quit (Remote host closed the connection)
[3:26] * johanni (~johanni@24.4.41.97) has joined #ceph
[3:26] * johanni_ (~johanni@24.4.41.97) has joined #ceph
[3:28] <Gospod> Kefu it does not need
[3:28] * Mika_c (~Mk@122.146.93.152) Quit (Remote host closed the connection)
[3:28] * Mika_c (~Mk@122.146.93.152) has joined #ceph
[3:28] <Gospod> Just tell me the answer to my question
[3:28] * Concubidated (~Adium@irvine-dc.dreamhost.com) has joined #ceph
[3:29] <Gospod> Can checksums be stored on a specific node?
[3:29] <Gospod> That is ALL chesums
[3:30] <kefu> Gospod: i am not sure i follow you. but i don't think we have a centralized place for the checksum or if the places we put the checksum are configurable.
[3:30] * primechuck (~primechuc@173-17-128-216.client.mchsi.com) Quit (Remote host closed the connection)
[3:31] * Mika_c (~Mk@122.146.93.152) Quit (Remote host closed the connection)
[3:31] * Mika_c (~Mk@122.146.93.152) has joined #ceph
[3:31] * zack_dolby (~textual@pa3b3a1.tokynt01.ap.so-net.ne.jp) Quit (Ping timeout: 480 seconds)
[3:32] * wschulze (~wschulze@cpe-69-206-242-231.nyc.res.rr.com) Quit (Ping timeout: 480 seconds)
[3:34] * shohn (~shohn@dslb-188-102-027-024.188.102.pools.vodafone-ip.de) has joined #ceph
[3:36] * darkid (~darkid@3DDAAAM6Q.tor-irc.dnsbl.oftc.net) Quit ()
[3:36] * Nijikokun (~Esge@213.5.66.4) has joined #ceph
[3:37] * Mika_c (~Mk@122.146.93.152) Quit (Remote host closed the connection)
[3:37] * Mika_c (~Mk@122.146.93.152) has joined #ceph
[3:37] * scuttlemonkey is now known as scuttle|afk
[3:39] * shohn1 (~shohn@dslb-094-222-211-105.094.222.pools.vodafone-ip.de) Quit (Ping timeout: 480 seconds)
[3:45] * primechuck (~primechuc@173-17-128-216.client.mchsi.com) has joined #ceph
[3:45] * Mika_c (~Mk@122.146.93.152) Quit (Remote host closed the connection)
[3:45] * vata (~vata@cable-21.246.173-197.electronicbox.net) Quit (Quit: Leaving.)
[3:46] * Mika_c (~Mk@122.146.93.152) has joined #ceph
[3:48] * adrian15b (~kvirc@80.Red-79-151-228.dynamicIP.rima-tde.net) has joined #ceph
[3:48] * Concubidated (~Adium@irvine-dc.dreamhost.com) Quit (Quit: Leaving.)
[3:49] <adrian15b> Hi, I would like to change my settings for avoiding high I/O on rebalancing. I've seen these commands: https://www.mail-archive.com/ceph-users@lists.ceph.com/msg08997.html . My question is how to gather default values so that I can restore default values if I want in a future. Thank you.
[3:55] * georgem (~Adium@24.140.226.3) has joined #ceph
[3:55] * Nacer (~Nacer@2001:41d0:fe82:7200:2d0a:22d8:5914:58fe) has joined #ceph
[3:55] <Nats> adrian15b, you can either look through the docs for each setting, the default is there. or you can "ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config get <variable>
[3:56] <adrian15b> Nats: I think I will use the command. Thank you.
[3:56] <Nats> adrian15b, there's also 'config show' to get it to spit out the entire active config
[3:57] <kefu> adrian15b: and the doc: http://ceph.com/docs/master/rados/configuration/ceph-conf/#viewing-a-configuration-at-runtime
[3:57] * johanni__ (~johanni@24.4.41.97) has joined #ceph
[4:00] * Gospod (~oftc-webi@cpe2-30-51.cable.triera.net) Quit (Remote host closed the connection)
[4:04] * johanni_ (~johanni@24.4.41.97) Quit (Ping timeout: 480 seconds)
[4:06] * Nijikokun (~Esge@213.5.66.4) Quit ()
[4:06] * Revo84 (~Bwana@195.169.125.226) has joined #ceph
[4:12] * johanni_ (~johanni@24.4.41.97) has joined #ceph
[4:19] * wschulze (~wschulze@cpe-69-206-242-231.nyc.res.rr.com) has joined #ceph
[4:19] * johanni (~johanni@24.4.41.97) Quit (Ping timeout: 480 seconds)
[4:36] * Revo84 (~Bwana@9S0AAALJD.tor-irc.dnsbl.oftc.net) Quit ()
[4:36] * galaxyAbstractor (~tokie@176.10.99.206) has joined #ceph
[4:38] * wschulze (~wschulze@cpe-69-206-242-231.nyc.res.rr.com) Quit (Read error: Connection reset by peer)
[4:38] * wschulze (~wschulze@cpe-69-206-242-231.nyc.res.rr.com) has joined #ceph
[4:47] * imjpr (~imjpr@dsl017-120-156.bhm1.dsl.speakeasy.net) has joined #ceph
[4:47] * itsjpr (~imjpr@dsl017-120-156.bhm1.dsl.speakeasy.net) has joined #ceph
[4:51] * CScrace (cb638001@107.161.19.109) has joined #ceph
[4:52] * kefu (~kefu@114.92.116.93) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[4:53] * Mika_c (~Mk@122.146.93.152) Quit (Remote host closed the connection)
[4:54] <CScrace> ceph-deploy osd prepare is not creating symlinks properly, /dev/disk/by-partuuid/<UUID> doesn't point to anything. Anyone had this issue before?
[4:54] * dyasny (~dyasny@198.251.58.23) Quit (Ping timeout: 480 seconds)
[4:55] * kefu (~kefu@114.92.116.93) has joined #ceph
[4:56] * t0rn (~ssullivan@c-68-62-1-186.hsd1.mi.comcast.net) has joined #ceph
[4:58] * johanni (~johanni@24.4.41.97) has joined #ceph
[5:00] * primechuck (~primechuc@173-17-128-216.client.mchsi.com) Quit (Remote host closed the connection)
[5:04] * johanni__ (~johanni@24.4.41.97) Quit (Ping timeout: 480 seconds)
[5:05] * c4tech (~c4tech@199.91.185.156) Quit (Ping timeout: 480 seconds)
[5:06] * galaxyAbstractor (~tokie@9S0AAALLK.tor-irc.dnsbl.oftc.net) Quit ()
[5:06] * Gecko19861 (~Azerothia@89.105.194.70) has joined #ceph
[5:12] * zaitcev (~zaitcev@2001:558:6001:10:61d7:f51f:def8:4b0f) Quit (Quit: Bye)
[5:12] * valeech (~valeech@pool-72-86-37-215.clppva.fios.verizon.net) has joined #ceph
[5:15] * overclk (~overclk@121.244.87.117) has joined #ceph
[5:15] * itsjpr (~imjpr@dsl017-120-156.bhm1.dsl.speakeasy.net) Quit (Ping timeout: 480 seconds)
[5:16] * imjpr (~imjpr@dsl017-120-156.bhm1.dsl.speakeasy.net) Quit (Ping timeout: 480 seconds)
[5:16] * flisky (~Thunderbi@106.39.60.34) has joined #ceph
[5:16] * ketor (~ketor@182.48.117.114) has joined #ceph
[5:23] * calvinx (~calvin@101.100.172.246) has joined #ceph
[5:26] * Vacuum__ (~Vacuum@88.130.211.207) has joined #ceph
[5:28] * vbellur (~vijay@122.171.123.165) has joined #ceph
[5:28] * johanni__ (~johanni@24.4.41.97) has joined #ceph
[5:33] * Vacuum_ (~Vacuum@i59F79744.versanet.de) Quit (Ping timeout: 480 seconds)
[5:35] * johanni (~johanni@24.4.41.97) Quit (Ping timeout: 480 seconds)
[5:36] * Gecko19861 (~Azerothia@5NZAAC8KO.tor-irc.dnsbl.oftc.net) Quit ()
[5:36] * curtis864 (~Thononain@176.10.104.240) has joined #ceph
[5:36] * dneary (~dneary@pool-96-252-45-212.bstnma.fios.verizon.net) Quit (Ping timeout: 480 seconds)
[5:39] * ketor (~ketor@182.48.117.114) Quit (Remote host closed the connection)
[5:41] * ketor (~ketor@182.48.117.114) has joined #ceph
[5:43] * CheKoLyN (~saguilar@13.4.15.143) Quit (Ping timeout: 480 seconds)
[5:46] * ketor (~ketor@182.48.117.114) Quit (Remote host closed the connection)
[5:46] * vbellur (~vijay@122.171.123.165) Quit (Ping timeout: 480 seconds)
[5:54] * valeech (~valeech@pool-72-86-37-215.clppva.fios.verizon.net) Quit (Quit: valeech)
[5:55] * KevinPerks (~Adium@cpe-75-177-32-14.triad.res.rr.com) Quit (Quit: Leaving.)
[5:58] * raw (~raw@37.48.65.172) Quit (Ping timeout: 480 seconds)
[6:03] * i_m (~ivan.miro@nat-5-carp.hcn-strela.ru) has joined #ceph
[6:06] * irq0 (~seri@amy.irq0.org) Quit (Ping timeout: 480 seconds)
[6:06] * squ (~Thunderbi@46.109.36.167) has joined #ceph
[6:06] * curtis864 (~Thononain@8Q4AAA8SK.tor-irc.dnsbl.oftc.net) Quit ()
[6:06] * irq0 (~seri@amy.irq0.org) has joined #ceph
[6:07] * raw (~raw@37.48.65.169) has joined #ceph
[6:10] * Peaced (~sese_@nx-74205.tor-exit.network) has joined #ceph
[6:13] * kefu (~kefu@114.92.116.93) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[6:15] * johanni__ (~johanni@24.4.41.97) Quit (Remote host closed the connection)
[6:15] * jiyer (~chatzilla@63.229.31.161) Quit (Quit: ChatZilla 0.9.91.1 [Firefox 37.0.2/20150417180024])
[6:16] * johanni (~johanni@24.4.41.97) has joined #ceph
[6:18] * kanagaraj (~kanagaraj@117.216.108.53) has joined #ceph
[6:19] * kefu (~kefu@114.92.116.93) has joined #ceph
[6:20] * amote (~amote@121.244.87.116) has joined #ceph
[6:21] * erice (~eric@50.245.231.209) Quit ()
[6:22] * johanni_ (~johanni@24.4.41.97) Quit (Ping timeout: 480 seconds)
[6:23] * moore (~moore@97-124-123-201.phnx.qwest.net) has joined #ceph
[6:24] * johanni (~johanni@24.4.41.97) Quit (Ping timeout: 480 seconds)
[6:29] * wschulze (~wschulze@cpe-69-206-242-231.nyc.res.rr.com) Quit (Quit: Leaving.)
[6:29] * johanni (~johanni@24.4.41.97) has joined #ceph
[6:29] * johanni_ (~johanni@24.4.41.97) has joined #ceph
[6:31] * kefu (~kefu@114.92.116.93) Quit (Max SendQ exceeded)
[6:32] * kefu (~kefu@114.92.116.93) has joined #ceph
[6:38] * [arx] (~arx@six.mac-anu.org) Quit (Ping timeout: 480 seconds)
[6:38] * [arx] (~arx@sniff-the.kittypla.net) has joined #ceph
[6:40] * Peaced (~sese_@9S0AAALQG.tor-irc.dnsbl.oftc.net) Quit ()
[6:40] * theghost99 (~Helleshin@176.10.99.205) has joined #ceph
[6:44] * georgem (~Adium@24.140.226.3) Quit (Quit: Leaving.)
[6:48] * zack_dolby (~textual@pa3b3a1.tokynt01.ap.so-net.ne.jp) has joined #ceph
[6:56] * vikhyat (~vumrao@121.244.87.116) has joined #ceph
[7:00] * kanagaraj_ (~kanagaraj@117.213.131.213) has joined #ceph
[7:06] * johanni_ (~johanni@24.4.41.97) Quit (Ping timeout: 480 seconds)
[7:06] * kanagaraj__ (~kanagaraj@117.197.186.192) has joined #ceph
[7:07] * kanagaraj (~kanagaraj@117.216.108.53) Quit (Ping timeout: 480 seconds)
[7:09] * johanni (~johanni@24.4.41.97) Quit (Ping timeout: 480 seconds)
[7:10] * vbellur (~vijay@122.171.126.24) has joined #ceph
[7:10] * theghost99 (~Helleshin@8Q4AAA8VG.tor-irc.dnsbl.oftc.net) Quit ()
[7:10] * Linkshot (~richardus@72.ip-198-50-145.net) has joined #ceph
[7:11] * karnan (~karnan@121.244.87.117) has joined #ceph
[7:11] * kanagaraj__ (~kanagaraj@117.197.186.192) Quit (Quit: Leaving)
[7:12] * kanagaraj_ (~kanagaraj@117.213.131.213) Quit (Ping timeout: 480 seconds)
[7:12] * derjohn_mob (~aj@tmo-113-20.customers.d1-online.com) Quit (Ping timeout: 480 seconds)
[7:12] * zhaochao (~zhaochao@125.39.8.226) has joined #ceph
[7:18] * johanni (~johanni@24.4.41.97) has joined #ceph
[7:20] * johanni_ (~johanni@24.4.41.97) has joined #ceph
[7:25] * moore (~moore@97-124-123-201.phnx.qwest.net) Quit (Remote host closed the connection)
[7:28] * Mika_c (~Mk@122.146.93.152) has joined #ceph
[7:35] * johanni_ (~johanni@24.4.41.97) Quit (Ping timeout: 480 seconds)
[7:39] * johanni (~johanni@24.4.41.97) Quit (Ping timeout: 480 seconds)
[7:40] * Linkshot (~richardus@5NZAAC8M7.tor-irc.dnsbl.oftc.net) Quit ()
[7:41] * hgjhgjh (~Chrissi_@politkovskaja.torservers.net) has joined #ceph
[7:44] * CScrace (cb638001@107.161.19.109) Quit (Quit: http://www.kiwiirc.com/ - A hand crafted IRC client)
[7:48] * linjan (~linjan@109.253.69.65) has joined #ceph
[7:55] * vikhyat (~vumrao@121.244.87.116) Quit (Quit: Leaving)
[7:56] * maxxware (~maxx@149.210.133.105) has joined #ceph
[7:59] * linjan (~linjan@109.253.69.65) Quit (Ping timeout: 480 seconds)
[7:59] * sleinen (~Adium@84-72-160-233.dclient.hispeed.ch) has joined #ceph
[7:59] * Mika_c (~Mk@122.146.93.152) Quit (Remote host closed the connection)
[8:00] * Mika_c (~Mk@122.146.93.152) has joined #ceph
[8:00] * sleinen1 (~Adium@2001:620:0:82::102) has joined #ceph
[8:02] * branto (~branto@213.175.37.10) has joined #ceph
[8:02] * Mika_c (~Mk@122.146.93.152) Quit (Remote host closed the connection)
[8:03] * sleinen1 (~Adium@2001:620:0:82::102) Quit (Read error: Connection reset by peer)
[8:06] * Mika_c (~Mk@122.146.93.152) has joined #ceph
[8:07] * sleinen (~Adium@84-72-160-233.dclient.hispeed.ch) Quit (Ping timeout: 480 seconds)
[8:10] * hgjhgjh (~Chrissi_@5NZAAC8OE.tor-irc.dnsbl.oftc.net) Quit ()
[8:11] * Kyso (~JohnO@179.43.152.254) has joined #ceph
[8:13] * cok (~chk@2a02:2350:18:1010:39d5:75f6:f18a:eb0b) has joined #ceph
[8:14] * vbellur (~vijay@122.171.126.24) Quit (Ping timeout: 480 seconds)
[8:15] * jks (~jks@178.155.151.121) has joined #ceph
[8:16] * fridim_ (~fridim@56-198-190-109.dsl.ovh.fr) has joined #ceph
[8:25] * Hemanth (~Hemanth@121.244.87.117) has joined #ceph
[8:31] * sleinen (~Adium@2001:620:0:82::104) has joined #ceph
[8:32] * cok (~chk@2a02:2350:18:1010:39d5:75f6:f18a:eb0b) Quit (Quit: Leaving.)
[8:33] * dugravot6 (~dugravot6@dn-infra-04.lionnois.univ-lorraine.fr) has joined #ceph
[8:33] * vbellur (~vijay@121.244.87.117) has joined #ceph
[8:34] * raw (~raw@37.48.65.169) Quit (Remote host closed the connection)
[8:35] * wicope (~wicope@0001fd8a.user.oftc.net) has joined #ceph
[8:36] * stiopa (~stiopa@cpc73828-dals21-2-0-cust630.20-2.cable.virginm.net) has joined #ceph
[8:39] * joshd1 (~jdurgin@68-119-140-18.dhcp.ahvl.nc.charter.com) has joined #ceph
[8:40] * sleinen (~Adium@2001:620:0:82::104) Quit (Read error: Connection reset by peer)
[8:40] * Kyso (~JohnO@8Q4AAA8YU.tor-irc.dnsbl.oftc.net) Quit ()
[8:40] * mLegion (~ItsCrimin@tor-exit2-readme.puckey.org) has joined #ceph
[8:43] * gaveen (~gaveen@175.157.8.81) has joined #ceph
[8:45] * oro (~oro@84-72-20-79.dclient.hispeed.ch) has joined #ceph
[9:00] * linjan (~linjan@195.110.41.9) has joined #ceph
[9:02] * Nacer (~Nacer@2001:41d0:fe82:7200:2d0a:22d8:5914:58fe) Quit (Remote host closed the connection)
[9:06] * kawa2014 (~kawa@89.184.114.246) has joined #ceph
[9:06] * naga1 (~oftc-webi@idp01webcache2-z.apj.hpecore.net) has joined #ceph
[9:07] <naga1> i have a doubt can somebody answer me?
[9:08] <naga1> i want to deploy ceph cluster with 3 initial monitors at a time,
[9:09] <naga1> my question is all the 3 initial monitors should have same monitor and client admin keyring?
[9:09] * bitserker (~toni@88.87.194.130) has joined #ceph
[9:09] <naga1> or it can be difeerent?
[9:09] * oro (~oro@84-72-20-79.dclient.hispeed.ch) Quit (Ping timeout: 480 seconds)
[9:10] * nsoffer (~nsoffer@bzq-79-177-255-248.red.bezeqint.net) has joined #ceph
[9:10] * mLegion (~ItsCrimin@5NZAAC8QJ.tor-irc.dnsbl.oftc.net) Quit ()
[9:11] * Jyron (~Borf@5.175.204.131) has joined #ceph
[9:13] * ngoswami (~ngoswami@121.244.87.116) has joined #ceph
[9:14] * ketor (~ketor@182.48.117.114) has joined #ceph
[9:14] * Concubidated (~Adium@71.21.5.251) has joined #ceph
[9:16] * analbeard (~shw@support.memset.com) has joined #ceph
[9:16] * analbeard (~shw@support.memset.com) has left #ceph
[9:22] * Nacer (~Nacer@252-87-190-213.intermediasud.com) has joined #ceph
[9:29] * linjan (~linjan@195.110.41.9) Quit (Ping timeout: 480 seconds)
[9:30] * ketor (~ketor@182.48.117.114) Quit (Remote host closed the connection)
[9:32] <kefu> naga1: the monitor keyrings can be different, but you need to configure them to trust each other. to let them share the same keyring would be an easier way, and it's the recommended way.
[9:32] <kefu> naga1, see http://ceph.com/docs/master/install/manual-deployment/
[9:33] * ismell (~ismell@host-64-17-89-242.beyondbb.com) has joined #ceph
[9:34] * linjan (~linjan@195.110.41.9) has joined #ceph
[9:35] * TMM (~hp@sams-office-nat.tomtomgroup.com) has joined #ceph
[9:36] * fsimonce (~simon@host253-71-dynamic.3-87-r.retail.telecomitalia.it) has joined #ceph
[9:40] * ismell_ (~ismell@host-64-17-89-216.beyondbb.com) Quit (Ping timeout: 480 seconds)
[9:40] * Jyron (~Borf@5.175.204.131) Quit ()
[9:40] * Dragonshadow (~Kidlvr@37.187.129.166) has joined #ceph
[9:47] * ramonskie (ab15507e@107.161.19.53) has joined #ceph
[9:48] * stiopa (~stiopa@cpc73828-dals21-2-0-cust630.20-2.cable.virginm.net) Quit (Ping timeout: 480 seconds)
[9:49] * dgurtner (~dgurtner@178.197.231.155) has joined #ceph
[9:51] * linjan (~linjan@195.110.41.9) Quit (Ping timeout: 480 seconds)
[9:52] * jclm (~jclm@118.130.198.164) Quit (Quit: Leaving.)
[9:53] * vikhyat (~vumrao@121.244.87.116) has joined #ceph
[9:55] * vikhyat (~vumrao@121.244.87.116) Quit ()
[9:55] * ramonskie (ab15507e@107.161.19.53) Quit (Quit: http://www.kiwiirc.com/ - A hand crafted IRC client)
[9:55] * sleinen (~Adium@ext-nat-254.eduroam.unibe.ch) has joined #ceph
[9:57] * sleinen1 (~Adium@2001:620:0:82::10c) has joined #ceph
[10:01] * linjan (~linjan@109.253.68.220) has joined #ceph
[10:01] * ketor (~ketor@182.48.117.114) has joined #ceph
[10:03] * sleinen (~Adium@ext-nat-254.eduroam.unibe.ch) Quit (Ping timeout: 480 seconds)
[10:04] * ketor (~ketor@182.48.117.114) Quit (Remote host closed the connection)
[10:04] * ketor (~ketor@182.48.117.114) has joined #ceph
[10:05] * joshd1 (~jdurgin@68-119-140-18.dhcp.ahvl.nc.charter.com) Quit (Quit: Leaving.)
[10:07] * naga1 (~oftc-webi@idp01webcache2-z.apj.hpecore.net) Quit (Remote host closed the connection)
[10:07] <jrocha> kefu, hi there
[10:08] <jrocha> kefu, so continuing our chat yesterday, I noticed after looking into hello that "write" CLS methods cannot return an out buffer
[10:08] <jrocha> kefu, what I don't get is why it doesn't get returned if a method is WR| RD
[10:10] <kefu> jrocha: gregsfortytwo also answered your q.
[10:10] * Dragonshadow (~Kidlvr@9S0AAAL2F.tor-irc.dnsbl.oftc.net) Quit ()
[10:10] * Frymaster (~toast@9S0AAAL35.tor-irc.dnsbl.oftc.net) has joined #ceph
[10:11] <kefu> jrocha: <quote> this is because returning the same data if the op gets replayed is very difficult or impossible :( and we need to handle that transparently, so you don't ever get to return any data besides the return code</quote>
[10:12] <jrocha> kefu, I don't understand why but anyway I don't know about those internal details that much ATM
[10:13] <jrocha> kefu, there's another question I got regarding sending data over bufferlists.
[10:13] <jrocha> kefu, so this CLS class of mine does arithmetic ops on omap values
[10:13] <kefu> i think greg's explanation makes sense.
[10:13] <jrocha> kefu, this means the omap will hold e.g. a double
[10:14] <jrocha> kefu, and I add/sub/mul/div another value
[10:14] <jrocha> kefu, it's convenient to just encode the numeric value I'm using directly in the bufferlist
[10:14] <jrocha> kefu, however, I don't know how it's handled for different archs
[10:15] <jrocha> kefu, say my client's arch is different than the server's
[10:15] <jrocha> kefu, maybe there's trouble when encoding that number in the bufferlist and send it to the server, right?
[10:16] <jrocha> kefu, the workaround is to convert the numeric value to string, which is the type I'll use to store the data in the omap in the end anyway.
[10:16] <kefu> jrocha: i'd say that ceph are not very tolerant under this scenario.
[10:17] <kefu> i forgot where i got this impression.
[10:17] <jrocha> kefu, so I am right to assume that there could be trouble if my client is 32bit and the server is 64bit?
[10:19] <kefu> jrocha: i am not 100% sure, but just have a vague impression that rados try to be have an arch-independent protocol, but something at some place at somewhere are not doing good in this perspective.
[10:20] <jrocha> kefu, okay, then I'll do the num->string hack. not so beautiful but oh well
[10:21] <kefu> jrocha: have you tried some data type like uint32_t ?
[10:22] * joao is now known as joao|afl
[10:22] * joao|afl is now known as joao|afk
[10:23] * johanni (~johanni@24.4.41.97) has joined #ceph
[10:24] * shang (~ShangWu@175.41.48.77) Quit (Quit: Ex-Chat)
[10:24] <kefu> jrocha: the variable of primitive types are just appended at it is to the bufferlist.
[10:24] * shang (~ShangWu@175.41.48.77) has joined #ceph
[10:24] * johanni_ (~johanni@24.4.41.97) has joined #ceph
[10:25] <kefu> so as long as the length/endian of it is the same, i386 should be able to decoded amd64, or vice versa.
[10:27] * jordanP (~jordan@scality-jouf-2-194.fib.nerim.net) has joined #ceph
[10:28] * Concubidated (~Adium@71.21.5.251) Quit (Quit: Leaving.)
[10:32] * daviddcc (~dcasier@84.197.151.77.rev.sfr.net) Quit (Ping timeout: 480 seconds)
[10:35] * blynch (~blynch@vm-nat.msi.umn.edu) Quit (Ping timeout: 480 seconds)
[10:36] * ketor (~ketor@182.48.117.114) Quit (Remote host closed the connection)
[10:39] * derjohn_mob (~aj@tmo-110-66.customers.d1-online.com) has joined #ceph
[10:40] * Frymaster (~toast@9S0AAAL35.tor-irc.dnsbl.oftc.net) Quit ()
[10:44] * naga1 (~oftc-webi@idp01webcache2-z.apj.hpecore.net) has joined #ceph
[10:50] * oro (~oro@2001:620:20:16:b5ff:10b9:d8a8:b807) has joined #ceph
[10:52] * johanni (~johanni@24.4.41.97) Quit (Ping timeout: 480 seconds)
[10:53] * ketor (~ketor@182.48.117.114) has joined #ceph
[10:54] * johanni_ (~johanni@24.4.41.97) Quit (Ping timeout: 480 seconds)
[11:01] * linjan (~linjan@109.253.68.220) Quit (Ping timeout: 480 seconds)
[11:03] * johanni (~johanni@24.4.41.97) has joined #ceph
[11:03] * ramonskie (ab15507e@107.161.19.53) has joined #ceph
[11:04] * johanni_ (~johanni@24.4.41.97) has joined #ceph
[11:04] <ramonskie> just tried to add a monitor with ceph-deploy mon add command and now i see in my current monitor log the following "cephx: verify_authorizer could not decrypt ticket info: error: NSS AES final round failed: -8190"
[11:04] * mzehrer_ (~mzehrer@ip5b404bf0.dynamic.kabel-deutschland.de) has joined #ceph
[11:04] <ramonskie> and on my newly created monitor is see "cephx: verify_reply couldn't decrypt with error: error decoding block for decryption"
[11:05] <mzehrer_> Hi, after some networking problems my cluster show the following state: "health HEALTH_WARN 20 pgs peering; 95 pgs stuck inactive; 95 pgs stuck unclean" What can I do?
[11:06] <ramonskie> mzehrer_ it should recover in a few minutes
[11:07] <mzehrer_> No, it's now in this state for a few days...
[11:09] <ramonskie> does it have 20 pg peering constantly? than you have probably poor perfomance too
[11:09] <ramonskie> the best thing to do now is to restart each osd
[11:10] <ramonskie> restart ceph-osd id=<osdid>
[11:10] <ramonskie> and see if it recovers
[11:11] * ketor (~ketor@182.48.117.114) Quit (Remote host closed the connection)
[11:13] * linjan (~linjan@195.110.41.9) has joined #ceph
[11:14] * H0mmi3 (~h0m3r@hosd.leaseweb.net) has joined #ceph
[11:14] <adrian15b> What if I want to "out" some ODSs and the crush not being rebuilt so that no more rebalance is even tried ? Any clue ? Thank you.
[11:16] <ramonskie> uhm just stop the osd and wait for recovering and after that crush the osd???
[11:16] * t0rn (~ssullivan@c-68-62-1-186.hsd1.mi.comcast.net) Quit (Ping timeout: 480 seconds)
[11:16] <adrian15b> I don't the recovery to happen
[11:16] <adrian15b> I just want to do like if I turned town a node
[11:16] <adrian15b> You know what I mean
[11:17] * H0mmi3 is now known as Romero
[11:17] <ramonskie> well you can temporarly disable the recover feature
[11:17] <adrian15b> ramonskie: How to do that ?
[11:17] * Romero is now known as romero
[11:18] <adrian15b> ramonskie: Please.
[11:18] * romero is now known as RomeroJnr
[11:18] * ketor (~ketor@182.48.117.114) has joined #ceph
[11:19] <ramonskie> i don't know the exact command i do this from within calamari
[11:19] <adrian15b> I guess calamari is GUI. Hopefully someone else know the commands
[11:20] <ramonskie> ceph osd set norecovery i think
[11:20] * i_m (~ivan.miro@nat-5-carp.hcn-strela.ru) Quit (Ping timeout: 480 seconds)
[11:21] <ramonskie> ceph osd set norecover
[11:22] <adrian15b> ramonskie: Thank you very much! Let's hope that makes the trick
[11:23] <ramonskie> still no idea why you want this tough
[11:25] * ksperis (~ksperis@46.218.42.103) Quit (Quit: Quitte)
[11:31] * lucas1 (~Thunderbi@218.76.52.64) Quit (Quit: lucas1)
[11:32] <RomeroJnr> Is it normal for the "clock skew detected" to take a lot of time to
[11:33] <RomeroJnr> Is it normal for the "clock skew detected" warning to take a lot of time to recover? (after syncronizing the clocks of all monitoring nodes)*
[11:35] * ksperis (~ksperis@46.218.42.103) has joined #ceph
[11:35] * ksperis (~ksperis@46.218.42.103) Quit ()
[11:39] * ksperis (~ksperis@46.218.42.103) has joined #ceph
[11:39] * ksperis (~ksperis@46.218.42.103) Quit ()
[11:40] * Lunk2 (~Guest1390@marylou.nos-oignons.net) has joined #ceph
[11:44] * ksperis (~ksperis@46.218.42.103) has joined #ceph
[11:45] <RomeroJnr> well, restart ceph-mon-all does the trick
[11:47] <adrian15b> RomeroJnr: Yeah. Howtos just say about resyncing with ntp and local ntps.
[11:48] <adrian15b> RomeroJnr: But the only way that worked for me was to do to do those ntp sync steps and then stop and start the associated mons.
[11:50] * mzehrer_ (~mzehrer@ip5b404bf0.dynamic.kabel-deutschland.de) Quit (Quit: leaving)
[11:51] * raw (~raw@37.48.65.169) has joined #ceph
[11:52] * linjan (~linjan@195.110.41.9) Quit (Ping timeout: 480 seconds)
[11:53] * johanni (~johanni@24.4.41.97) Quit (Ping timeout: 480 seconds)
[11:55] * johanni_ (~johanni@24.4.41.97) Quit (Ping timeout: 480 seconds)
[12:01] * linjan (~linjan@46.210.218.172) has joined #ceph
[12:05] * johanni (~johanni@24.4.41.97) has joined #ceph
[12:06] * bene (~ben@c-24-60-237-191.hsd1.nh.comcast.net) has joined #ceph
[12:06] * johanni_ (~johanni@24.4.41.97) has joined #ceph
[12:10] * Lunk2 (~Guest1390@5NZAAC8YS.tor-irc.dnsbl.oftc.net) Quit ()
[12:10] * AGaW (~HoboPickl@37.187.129.166) has joined #ceph
[12:19] * nils__ (~nils@doomstreet.collins.kg) has joined #ceph
[12:22] * johanni_ (~johanni@24.4.41.97) Quit (Ping timeout: 480 seconds)
[12:26] * sleinen1 (~Adium@2001:620:0:82::10c) Quit (Ping timeout: 480 seconds)
[12:26] * johanni (~johanni@24.4.41.97) Quit (Ping timeout: 480 seconds)
[12:28] * ketor (~ketor@182.48.117.114) Quit (Remote host closed the connection)
[12:30] * kefu is now known as kefu|afk
[12:33] * jclm (~jclm@211.177.245.106) has joined #ceph
[12:34] * Mika_c (~Mk@122.146.93.152) Quit (Quit: Konversation terminated!)
[12:36] * shang (~ShangWu@175.41.48.77) Quit (Quit: Ex-Chat)
[12:40] * AGaW (~HoboPickl@3DDAAANS1.tor-irc.dnsbl.oftc.net) Quit ()
[12:40] * K3NT1S_aw (~oracular@216.218.134.12) has joined #ceph
[12:45] * fdmanana__ (~fdmanana@bl13-138-253.dsl.telepac.pt) has joined #ceph
[12:46] * ChrisNBlum (~ChrisNBlu@dhcp-ip-190.dorf.rwth-aachen.de) has joined #ceph
[12:47] * itsjpr (~imjpr@dsl017-120-156.bhm1.dsl.speakeasy.net) has joined #ceph
[12:47] * imjpr (~imjpr@dsl017-120-156.bhm1.dsl.speakeasy.net) has joined #ceph
[12:53] * OutOfNoWhere (~rpb@199.68.195.102) Quit (Ping timeout: 480 seconds)
[12:53] * badone (~brad@CPE-121-215-241-179.static.qld.bigpond.net.au) Quit (Ping timeout: 480 seconds)
[13:03] * sleinen1 (~Adium@2001:620:0:82::104) has joined #ceph
[13:04] * treenerd (~treenerd@cpe90-146-100-181.liwest.at) has joined #ceph
[13:10] * johanni (~johanni@24.4.41.97) has joined #ceph
[13:10] * johanni_ (~johanni@24.4.41.97) has joined #ceph
[13:10] * K3NT1S_aw (~oracular@3DDAAANUA.tor-irc.dnsbl.oftc.net) Quit ()
[13:10] * kalleeen (~dontron@89.105.194.79) has joined #ceph
[13:14] * karnan (~karnan@121.244.87.117) Quit (Remote host closed the connection)
[13:19] * cok (~chk@2a02:2350:18:1010:f8d1:afb:ec57:f17) has joined #ceph
[13:19] * imjpr (~imjpr@dsl017-120-156.bhm1.dsl.speakeasy.net) Quit (Ping timeout: 480 seconds)
[13:19] * itsjpr (~imjpr@dsl017-120-156.bhm1.dsl.speakeasy.net) Quit (Ping timeout: 480 seconds)
[13:21] * bene (~ben@c-24-60-237-191.hsd1.nh.comcast.net) Quit (Quit: Konversation terminated!)
[13:23] * johanni (~johanni@24.4.41.97) Quit (Ping timeout: 480 seconds)
[13:24] * johanni_ (~johanni@24.4.41.97) Quit (Ping timeout: 480 seconds)
[13:24] * owasserm (~owasserm@52D9864F.cm-11-1c.dynamic.ziggo.nl) has joined #ceph
[13:26] * ketor (~ketor@182.48.117.114) has joined #ceph
[13:27] * ganders (~root@190.2.42.21) has joined #ceph
[13:29] * wicope (~wicope@0001fd8a.user.oftc.net) Quit (Read error: Connection reset by peer)
[13:29] * ketor (~ketor@182.48.117.114) Quit (Remote host closed the connection)
[13:29] * ketor (~ketor@182.48.117.114) has joined #ceph
[13:31] <roland_> If for fedora 21 ceph_deploy will not work (because there are no rpm packages or repository for it), must I do the manual installation?
[13:31] <ramonskie> use the git repo
[13:32] <roland_> Yes, I downloaded the git repository, and compiled everything. I mean the steps after that
[13:33] <ramonskie> after that you should be able to use ceph-deploy commands
[13:34] * johanni (~johanni@24.4.41.97) has joined #ceph
[13:35] * johanni_ (~johanni@24.4.41.97) has joined #ceph
[13:36] <ramonskie> but then again i'm not familiair with fedora enough
[13:36] * kefu|afk (~kefu@114.92.116.93) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[13:36] * ganders (~root@190.2.42.21) Quit (Quit: WeeChat 0.4.2)
[13:37] * ganders (~root@190.2.42.21) has joined #ceph
[13:39] * ganders (~root@190.2.42.21) Quit ()
[13:39] * wschulze (~wschulze@cpe-69-206-242-231.nyc.res.rr.com) has joined #ceph
[13:40] * ganders (~root@190.2.42.21) has joined #ceph
[13:40] * georgem (~Adium@fwnat.oicr.on.ca) has joined #ceph
[13:40] * stj (~stj@2604:a880:800:10::2cc:b001) Quit (Quit: leaving.)
[13:40] * stj (~stj@2604:a880:800:10::2cc:b001) has joined #ceph
[13:40] * kalleeen (~dontron@5NZAAC819.tor-irc.dnsbl.oftc.net) Quit ()
[13:40] * Maza (~VampiricP@zscore.mit.edu) has joined #ceph
[13:41] * ganders (~root@190.2.42.21) Quit ()
[13:42] * kefu (~kefu@114.92.116.93) has joined #ceph
[13:44] * ganders (~root@190.2.42.21) has joined #ceph
[13:46] * vikhyat (~vumrao@121.244.87.116) has joined #ceph
[13:47] * ChrisNBlum (~ChrisNBlu@dhcp-ip-190.dorf.rwth-aachen.de) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[13:50] * flisky (~Thunderbi@106.39.60.34) Quit (Ping timeout: 480 seconds)
[13:52] * kefu (~kefu@114.92.116.93) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[13:56] * gaveen (~gaveen@175.157.8.81) Quit (Ping timeout: 480 seconds)
[14:00] * naga1 (~oftc-webi@idp01webcache2-z.apj.hpecore.net) Quit (Quit: Page closed)
[14:02] * linjan (~linjan@46.210.218.172) Quit (Ping timeout: 480 seconds)
[14:03] * marrusl (~mark@cpe-24-90-46-248.nyc.res.rr.com) Quit (Quit: bye!)
[14:04] * gaveen (~gaveen@175.157.8.81) has joined #ceph
[14:05] * kefu (~kefu@114.92.116.93) has joined #ceph
[14:06] * marrusl (~mark@cpe-24-90-46-248.nyc.res.rr.com) has joined #ceph
[14:07] * daviddcc (~dcasier@LCaen-656-1-144-187.w217-128.abo.wanadoo.fr) has joined #ceph
[14:09] * johanni (~johanni@24.4.41.97) Quit (Ping timeout: 480 seconds)
[14:10] * Maza (~VampiricP@3DDAAANWV.tor-irc.dnsbl.oftc.net) Quit ()
[14:10] * Mousey (~w2k@104.238.174.29) has joined #ceph
[14:12] * linjan (~linjan@46.210.218.172) has joined #ceph
[14:12] * johanni_ (~johanni@24.4.41.97) Quit (Ping timeout: 480 seconds)
[14:12] * valeech (~valeech@pool-72-86-37-215.clppva.fios.verizon.net) has joined #ceph
[14:13] * ketor (~ketor@182.48.117.114) Quit (Remote host closed the connection)
[14:13] * treenerd (~treenerd@cpe90-146-100-181.liwest.at) Quit (Ping timeout: 480 seconds)
[14:13] <tuxcraft1r> i used ceph-deploy mon create-initial
[14:14] <tuxcraft1r> to setup my inital cluster
[14:14] * dneary (~dneary@nat-pool-bos-u.redhat.com) has joined #ceph
[14:14] <tuxcraft1r> and then used ceph-disk prepare --cluster ceph --cluster-uuid 0d690e07-c6e0-465e-9be2-56fa2bc35117 --fs-type ext4 /dev/sda1
[14:14] <tuxcraft1r> ceph-disk activate /dev/sda1
[14:14] <tuxcraft1r> etc. on all my nodes
[14:15] <tuxcraft1r> and added 6 osds
[14:15] <tuxcraft1r> however they are not added to my /etc/ceph.conf
[14:15] <tuxcraft1r> and when i reboot the nodes the osd are not started
[14:15] <tuxcraft1r> i added some configs on my first node
[14:15] <tuxcraft1r> and try to start them
[14:15] <tuxcraft1r> but i now get this error
[14:15] <tuxcraft1r> 2015-06-04 13:33:53.345507 7f347da7f700 -1 monclient(hunting): ERROR: missing keyring, cannot use cephx for authentication
[14:15] <tuxcraft1r> 2015-06-04 13:33:53.345514 7f347da7f700 0 librados: osd.1 initialization error (2) No such file or directory
[14:16] * jdillaman (~jdillaman@pool-108-18-97-82.washdc.fios.verizon.net) has joined #ceph
[14:16] <tuxcraft1r> where can i find the documentation to figure out what I should do
[14:16] <raw> tuxcraft1r, the osds do not need to be added to ceph.conf. you actually dont need a [osd] section in you ceph.conf at all if you are doing nothing special
[14:17] <raw> if you have the complete /dev/sda disk available for ceph to use, you should give /dev/sda to ceph-deploy prepare because it will create the partition layout for you
[14:18] <raw> ceph uses special gpt partition types to autodetect which osds live on wich hdd. you do not need to add them to /etc/fstab or to any config because of this. as soon as the hdds have the correct formatting, they will be autodetected
[14:19] <raw> if you can't dedicate the whole drive to ceph or require a special partition layout, i can give you instructions how to create them so auto-detection works
[14:20] <tuxcraft1r> raw: thanks i will search for some ceph-deploy documentation then
[14:20] * johanni (~johanni@24.4.41.97) has joined #ceph
[14:20] * johanni_ (~johanni@24.4.41.97) has joined #ceph
[14:21] <raw> before giving a while drive to ceph-deploy, you may need to do a ceph-deploy disk zap to purge previous data from them
[14:21] <raw> s/while/whole/
[14:30] * amote (~amote@121.244.87.116) Quit (Quit: Leaving)
[14:30] <ramonskie> anyone here with ceph skill i can't seem to add a monitor it just keeps nagging about cephx
[14:31] <nils__> I'm trying to mount a mapped RBD (clone of a snapshot), however I'm getting a message that the device is already mounted or the mount point is busy
[14:32] <nils__> open("/dev/rbd0p3", O_RDONLY|O_EXCL) = -1 EBUSY (Device or resource busy)
[14:32] <raw> nils__, what does lsof say?
[14:32] * ksperis (~ksperis@46.218.42.103) Quit (Ping timeout: 480 seconds)
[14:33] * georgem (~Adium@fwnat.oicr.on.ca) Quit (Read error: Connection reset by peer)
[14:33] <nils__> only process is the kernel rbd0 process
[14:34] * nils__ is now known as nils_
[14:34] * TMM (~hp@sams-office-nat.tomtomgroup.com) Quit (Quit: Ex-Chat)
[14:34] <nils_> interestingly I can unmap it without problem after removing the partition nodes
[14:35] <nils_> seems like my calling kpartx breaks it, the partitions are auto detected anyways.
[14:35] * DV_ (~veillard@2001:41d0:a:f29f::1) has joined #ceph
[14:36] * squ (~Thunderbi@46.109.36.167) Quit (Quit: squ)
[14:36] <raw> iirc kpartx is deprecated
[14:36] * TMM (~hp@sams-office-nat.tomtomgroup.com) has joined #ceph
[14:37] * johanni__ (~johanni@24.4.41.97) has joined #ceph
[14:38] * johanni (~johanni@24.4.41.97) Quit (Ping timeout: 480 seconds)
[14:40] * Mousey (~w2k@3DDAAANYN.tor-irc.dnsbl.oftc.net) Quit ()
[14:42] * KevinPerks (~Adium@cpe-75-177-32-14.triad.res.rr.com) has joined #ceph
[14:43] * DV (~veillard@2001:41d0:1:d478::1) Quit (Ping timeout: 480 seconds)
[14:43] * kefu (~kefu@114.92.116.93) Quit (Max SendQ exceeded)
[14:44] * kefu (~kefu@114.92.116.93) has joined #ceph
[14:44] * ksperis (~ksperis@46.218.42.103) has joined #ceph
[14:46] * bene (~ben@nat-pool-bos-t.redhat.com) has joined #ceph
[14:46] * ramonskie (ab15507e@107.161.19.53) Quit (Quit: http://www.kiwiirc.com/ - A hand crafted IRC client)
[14:46] * kefu (~kefu@114.92.116.93) Quit (Max SendQ exceeded)
[14:47] * kefu (~kefu@114.92.116.93) has joined #ceph
[14:52] * kefu (~kefu@114.92.116.93) Quit (Max SendQ exceeded)
[14:53] * georgem (~Adium@fwnat.oicr.on.ca) has joined #ceph
[14:54] * kefu (~kefu@114.92.116.93) has joined #ceph
[14:55] * ade (~abradshaw@tmo-102-78.customers.d1-online.com) has joined #ceph
[14:57] * derjohn_mob (~aj@tmo-110-66.customers.d1-online.com) Quit (Ping timeout: 480 seconds)
[14:58] <raw> im transfering a large file into my cephfs which has data on some hdds, i have 10GBit networking and i can see the file transfer start with a insane speed of 800MB/s
[14:58] <raw> but after some secs, the transfer stalles and ceph complains about slow requests
[14:59] * cdelatte (~cdelatte@2001:1998:2000:101::28) has joined #ceph
[14:59] <raw> does that mean that my journal is full?
[15:00] * delattec (~cdelatte@cpe-172-72-105-98.carolina.res.rr.com) has joined #ceph
[15:01] * tw0fish (~tw0fish@UNIX3.ANDREW.CMU.EDU) has joined #ceph
[15:01] * brad_mssw (~brad@66.129.88.50) has joined #ceph
[15:02] * SkyEye (~gaveen@175.157.24.1) has joined #ceph
[15:02] * cdelatte (~cdelatte@2001:1998:2000:101::28) Quit (Read error: Connection reset by peer)
[15:03] * overclk (~overclk@121.244.87.117) Quit (Quit: Leaving)
[15:04] * smerz (~ircircirc@37.74.194.90) has joined #ceph
[15:07] * tupper (~tcole@2001:420:2280:1272:8900:f9b8:3b49:567e) has joined #ceph
[15:08] * gaveen (~gaveen@175.157.8.81) Quit (Ping timeout: 480 seconds)
[15:08] * thomnico (~thomnico@2a01:e35:8b41:120:882b:f95f:f73:b556) has joined #ceph
[15:09] * johanni__ (~johanni@24.4.41.97) Quit (Ping timeout: 480 seconds)
[15:11] <roland_> what do I do now: [novamaris][WARNIN] The service command supports only basic LSB actions (start, stop, restart, try-restart, reload, force-reload, status). For other actions, please try to use systemctl.
[15:11] <roland_> ceph-deploy does not seem to support systemd?
[15:12] * karnan (~karnan@27.57.5.108) has joined #ceph
[15:12] <alfredodeza> roland_: a single line of output doesn't tell much, mind pasting the whole output somewhere?
[15:12] <alfredodeza> that is the reason why ceph-deploy is sometimes overly verbose
[15:12] <alfredodeza> one liners don't tell much :)
[15:13] <roland_> Ok: ceph-deploy mon create-initial
[15:13] <alfredodeza> that surely is not the whole output
[15:13] <alfredodeza> I really meant the whole output
[15:13] <roland_> <skip succesful lines, and then> Running command: /usr/sbin/service ceph -c /etc/ceph/ceph.conf start mon.novamaris
[15:13] <alfredodeza> no
[15:13] * johanni_ (~johanni@24.4.41.97) Quit (Ping timeout: 480 seconds)
[15:13] <alfredodeza> don't skip
[15:14] <alfredodeza> paste the whole output please
[15:14] <alfredodeza> in a paste site
[15:14] <roland_> Ok, I'll find a paste site
[15:14] <RomeroJnr> i have just deployed a 410 TB cluster, however the default pools data and metadata are not present (only rbd is present). am i missing something?
[15:15] <roland_> https://justpaste.it/edit/9256848/fa92d1b2
[15:15] * skney (~clusterfu@manning1.torservers.net) has joined #ceph
[15:15] * oro (~oro@2001:620:20:16:b5ff:10b9:d8a8:b807) Quit (Ping timeout: 480 seconds)
[15:15] <roland_> hmm, that was the edit link, this is the read link. Not that it matters, but...:http://justpaste.it/ljpx
[15:17] <alfredodeza> I don't think there are packages for FC21
[15:17] <roland_> So basically what happens is that ceph-deploy uses the old 'service start <something>' syntax. But it should use systemctl instead.
[15:18] <alfredodeza> roland_: how did you get ceph for FC21? from where?
[15:18] <alfredodeza> we don't have builds for it
[15:18] <roland_> alfredodeza, I got it via git and compiled it myself
[15:18] <alfredodeza> and this looks like it should probably get fixed in ceph-deploy
[15:18] <alfredodeza> but that is going to be tricky to verify because we don't have builds for it
[15:18] <alfredodeza> :/
[15:19] <roland_> On the monitors and all the machines that are going to be osd's
[15:20] * johanni (~johanni@24.4.41.97) has joined #ceph
[15:20] * jyoti-ranjan (~ranjanj@idp01webcache6-z.apj.hpecore.net) has joined #ceph
[15:21] <roland_> alfredodeza, I don't understand. It _is_ available on fedora 20, and fedora has had systemd since version 16 I think? Also, isn't the ceph company owned by Redhat since a year or so? I would assume some interest in getting it on all new versions of fedora?
[15:22] <alfredodeza> roland_: like I mentioned, this does sound like an issue. Would you mind creating a ticket in the tracker? http://tracker.ceph.com/projects/ceph-deploy/issues/new
[15:22] * jyoti-ranjan_ (~oftc-webi@idp01webcache6-z.apj.hpecore.net) has joined #ceph
[15:22] <alfredodeza> you will need an account I think, but that is pretty easy
[15:22] <jyoti-ranjan> Can we deploy ceph on only one node with three disks?
[15:22] * johanni_ (~johanni@24.4.41.97) has joined #ceph
[15:22] * linjan (~linjan@46.210.218.172) Quit (Ping timeout: 480 seconds)
[15:22] <roland_> Also, I tried to build the rpm's (there is a build script for it) but that went wrong. But for a developer debugging the making of rpms should not be that hard I think.
[15:23] <roland_> Sure I will create a bug report
[15:24] * jschmid (~jxs@nl13x.mullvad.net) has joined #ceph
[15:24] <roland_> Where is the python code of ceph-deploy located when installed?
[15:24] * itsjpr (~imjpr@164.111.234.201) has joined #ceph
[15:24] <roland_> I would like to look at it myself. Also I have a colleague here who is an ace python programmer.
[15:25] <alfredodeza> roland_: this is a simple fix I think
[15:25] <alfredodeza> roland_: ceph-deploy has modules for distros https://github.com/ceph/ceph-deploy/tree/master/ceph_deploy/hosts
[15:25] * imjpr (~imjpr@164.111.234.201) has joined #ceph
[15:26] <alfredodeza> roland_: so what you should look at is in here https://github.com/ceph/ceph-deploy/blob/master/ceph_deploy/hosts/fedora/mon/create.py
[15:27] * rlrevell (~leer@vbo1.inmotionhosting.com) has joined #ceph
[15:28] * harold (~hamiller@71-94-227-123.dhcp.mdfd.or.charter.com) has joined #ceph
[15:32] * jschmid (~jxs@nl13x.mullvad.net) Quit (Ping timeout: 480 seconds)
[15:32] * primechuck (~primechuc@host-95-2-129.infobunker.com) has joined #ceph
[15:32] * sleinen1 (~Adium@2001:620:0:82::104) Quit (Read error: Connection reset by peer)
[15:32] <roland_> Ok, but where in my server is this create.py located?
[15:33] <roland_> Oh I found it: /usr/lib/python2.7/site-packages/
[15:33] <roland_> of course.
[15:33] * sleinen1 (~Adium@2001:620:0:82::104) has joined #ceph
[15:33] <alfredodeza> roland_: http://fpaste.org/228853/33424809/
[15:33] <alfredodeza> that is the bullet proof of doing it
[15:33] <alfredodeza> not just finding a file because who knows if you have another version of it
[15:34] * vbellur (~vijay@121.244.87.117) Quit (Ping timeout: 480 seconds)
[15:37] <roland_> Thanks
[15:37] * johanni__ (~johanni@24.4.41.97) has joined #ceph
[15:38] * johanni- (~johanni@24.4.41.97) has joined #ceph
[15:38] * johanni (~johanni@24.4.41.97) Quit (Ping timeout: 480 seconds)
[15:40] <roland_> The create.py file is wrong for current fedora, I think. It indeed has lines mentioning 'service' and 'start' and 'ceph -c ...' etc. Instead it should put the equivalent systemctl commands there. But another problem is that the 'make install' procedure does not install the systemd unit files.
[15:40] * harold (~hamiller@71-94-227-123.dhcp.mdfd.or.charter.com) Quit (Quit: Leaving)
[15:41] * johanni_ (~johanni@24.4.41.97) Quit (Ping timeout: 480 seconds)
[15:43] * kefu (~kefu@114.92.116.93) Quit (Max SendQ exceeded)
[15:44] * kefu (~kefu@114.92.116.93) has joined #ceph
[15:45] * skney (~clusterfu@8Q4AAA9EB.tor-irc.dnsbl.oftc.net) Quit ()
[15:45] * Snowcat4 (~matx@ncc-1701-a.tor-exit.network) has joined #ceph
[15:46] <alfredodeza> as I understand it, it is going to be very difficult to test this without a proper build for FC21
[15:47] * dyasny (~dyasny@173.231.115.59) has joined #ceph
[15:47] <RomeroJnr> guys, any reason why ceph wouldnt create the default pools? the only pool created was the rbd
[15:48] <raw> RomeroJnr, for me, ceph only creates rbd
[15:48] * nsoffer (~nsoffer@bzq-79-177-255-248.red.bezeqint.net) Quit (Ping timeout: 480 seconds)
[15:48] <tuxcraft1r> raw: how do i stop an osd that is created with ceph-deploy osd create ceph02:/dev/sdb
[15:49] <tuxcraft1r> and therefor does not have an config in ceph.conf
[15:49] * zhaochao (~zhaochao@125.39.8.226) Quit (Quit: ChatZilla 0.9.91.1 [Iceweasel 38.0.1/20150526223604])
[15:49] <roland_> alfredodeza, well, pretty difficult anyway. But it is not necessary perse to use ceph-deploy, right? I should be able to use the manual installation procedure. But that is lengthy and error-prone.
[15:51] * kefu (~kefu@114.92.116.93) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[15:55] <raw> tuxcraft1r, no idea, i kill them manually. do not forget to unmount
[15:55] * derjohn_mob (~aj@x590e2160.dyn.telefonica.de) has joined #ceph
[15:57] * cok (~chk@2a02:2350:18:1010:f8d1:afb:ec57:f17) Quit (Quit: Leaving.)
[15:58] * linuxkidd__ (~linuxkidd@63.79.91.17) has joined #ceph
[15:58] * kefu (~kefu@114.92.116.93) has joined #ceph
[15:59] * jskinner (~jskinner@host-95-2-129.infobunker.com) has joined #ceph
[16:00] * xarses (~andreww@c-73-202-191-48.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[16:02] * vata (~vata@207.96.182.162) has joined #ceph
[16:02] * bene2 (~ben@nat-pool-bos-t.redhat.com) has joined #ceph
[16:03] <roland_> alfredodeza, so I created an account and made a ticket. The problems I described are:
[16:03] * jrankin (~jrankin@d53-64-170-236.nap.wideopenwest.com) has joined #ceph
[16:03] * oro (~oro@84-72-20-79.dclient.hispeed.ch) has joined #ceph
[16:04] * branto (~branto@213.175.37.10) has left #ceph
[16:04] <roland_> 1) no fedora 21 repositories. Should be not too hard too fix because rpm build scripts are already available on ceph.com. Only they fail (for me at least)
[16:04] <roland_> 1a) ceph-deploy should be able to use the fedora 20 repo, but it can't.
[16:06] <roland_> 2) ceph-deploy fails to use the proper commands for systemd. systemctl start ceph.mon or something similar, specifying the hostname and config file possibly.
[16:06] * imjpr (~imjpr@164.111.234.201) Quit (Ping timeout: 480 seconds)
[16:06] * itsjpr (~imjpr@164.111.234.201) Quit (Ping timeout: 480 seconds)
[16:06] * bene2 (~ben@nat-pool-bos-t.redhat.com) Quit ()
[16:08] <roland_> 3) The manual installation via git, with configure, make, make install etc. fails to install the systemd unit files. Yet they are in the git repo.
[16:08] * derjohn_mob (~aj@x590e2160.dyn.telefonica.de) Quit (Ping timeout: 480 seconds)
[16:08] <roland_> All of these errors seem pretty easy to fix for a good developer I would think.
[16:08] * RomeroJnr (~h0m3r@hosd.leaseweb.net) Quit ()
[16:09] * bene (~ben@nat-pool-bos-t.redhat.com) Quit (Ping timeout: 480 seconds)
[16:09] * johanni__ (~johanni@24.4.41.97) Quit (Ping timeout: 480 seconds)
[16:10] * wushudoin (~wushudoin@2601:9:4b00:f10:2ab2:bdff:fe0b:a6ee) has joined #ceph
[16:12] * bene (~ben@nat-pool-bos-t.redhat.com) has joined #ceph
[16:13] * johanni- (~johanni@24.4.41.97) Quit (Ping timeout: 480 seconds)
[16:15] * Snowcat4 (~matx@9S0AAAMMP.tor-irc.dnsbl.oftc.net) Quit ()
[16:15] * GuntherDW (~clusterfu@tor-exit2-readme.puckey.org) has joined #ceph
[16:17] * alram (~alram@192.41.52.12) has joined #ceph
[16:19] <rlrevell> does anyone know how many of the tests in https://github.com/ceph/s3-tests it is "normal" to fail?
[16:19] * sugoruyo (~georgev@paarthurnax.esc.rl.ac.uk) has joined #ceph
[16:20] * johanni (~johanni@24.4.41.97) has joined #ceph
[16:22] <tuxcraft1r> when using ceph-deploy osd create ceph03:/dev/sda && ceph-deploy osd create ceph03:/dev/sdb
[16:22] <tuxcraft1r> it will only activate one disk
[16:22] * johanni_ (~johanni@24.4.41.97) has joined #ceph
[16:22] <tuxcraft1r> the other one stays in prepared mode
[16:23] <raw> tuxcraft1r, and manually activating it? ceph-deploy osd activate ?
[16:23] * imjpr (~imjpr@164.111.234.201) has joined #ceph
[16:23] * itsjpr (~imjpr@164.111.234.201) has joined #ceph
[16:25] <roland_> alfredodeza, ok, I copied from the git build dir the file systemd/ceph-mon@.service to /etc/systemd/system
[16:25] <roland_> Then I was able to start ceph-mon on novamaris like this: systemctl start ceph-mon@novamaris
[16:27] <roland_> That worked. This did not: 'systemctl start ceph-mon', and 'systemctl start ceph-mon@'. So the @ means fill in the hostname apparantly
[16:28] <sugoruyo> hey folks, anyone ever try to run a big-ish cluster (1100-1500 OSDs, ~5PB raw) with a small number of PGs (say 2048 in total)??
[16:28] * vikhyat (~vumrao@121.244.87.116) Quit (Quit: Leaving)
[16:32] * daviddcc (~dcasier@LCaen-656-1-144-187.w217-128.abo.wanadoo.fr) Quit (Ping timeout: 480 seconds)
[16:33] * linjan (~linjan@46.210.247.138) has joined #ceph
[16:37] * linjan (~linjan@46.210.247.138) Quit (Read error: Connection reset by peer)
[16:37] * bene2 (~ben@nat-pool-bos-t.redhat.com) has joined #ceph
[16:37] * cvstealth (~mcarey@pool-72-66-71-26.washdc.fios.verizon.net) has joined #ceph
[16:38] * johanni__ (~johanni@24.4.41.97) has joined #ceph
[16:38] * johanni- (~johanni@24.4.41.97) has joined #ceph
[16:38] * johanni_ (~johanni@24.4.41.97) Quit (Ping timeout: 480 seconds)
[16:39] * derjohn_mob (~aj@x590e2160.dyn.telefonica.de) has joined #ceph
[16:40] * ade (~abradshaw@tmo-102-78.customers.d1-online.com) Quit (Quit: Too sexy for his shirt)
[16:42] <dephcon> sugoruyo, why would you want to run so few PGs?
[16:42] * johanni (~johanni@24.4.41.97) Quit (Ping timeout: 480 seconds)
[16:44] * bene (~ben@nat-pool-bos-t.redhat.com) Quit (Ping timeout: 480 seconds)
[16:44] <tuxcraft1r> [ceph03][DEBUG ] /dev/sdb :
[16:44] <tuxcraft1r> [ceph03][DEBUG ] /dev/sdb1 ceph data, prepared, cluster ceph, journal /dev/sdb2
[16:44] <tuxcraft1r> [ceph03][DEBUG ] /dev/sdb2 ceph journal, for /dev/sdb1
[16:44] <tuxcraft1r> how should the activate command look like?
[16:44] <cvstealth> I currently have a 3 node POC ceph deployment to be used as the backend for Openstack, long story short cinder is trying to run a "ceph df -f json" and looking for a value called max_available. Running the command by hand I don't see the value either and doing some googling see where folks have run ceph df and a column showing Max Avail in their output. Is there a certain feature that needs to be enabled i
[16:45] <cvstealth> n ceph.conf to get that value to be reported?
[16:45] <sugoruyo> dephcon: I don't, others do and I have to convince we don't want to
[16:45] * GuntherDW (~clusterfu@5NZAAC9CB.tor-irc.dnsbl.oftc.net) Quit ()
[16:45] * xENO_1 (~Kidlvr@spftor1e1.privacyfoundation.ch) has joined #ceph
[16:46] * KevinPerks1 (~Adium@cpe-75-177-32-14.triad.res.rr.com) has joined #ceph
[16:46] * KevinPerks (~Adium@cpe-75-177-32-14.triad.res.rr.com) Quit (Read error: Connection reset by peer)
[16:49] <raw> cvstealth, i have checked my hammer and firefly cluster, the attribute is there for me
[16:51] <tuxcraft1r> 2015-06-04 16:49:28.972445 7f3e01f4e7c0 -1 filestore(/var/lib/ceph/tmp/mnt.omEcYj) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
[16:53] <cvstealth> raw, thanks tired the latest of both and just realized that the /etc/init.d/ceph stop/start osd wasn't actually killing off the osd processes like it should, kill -9 them and restart on the later version fixed my issue.
[16:53] * KevinPerks1 (~Adium@cpe-75-177-32-14.triad.res.rr.com) Quit (Quit: Leaving.)
[16:53] <raw> cvstealth, are you using debian 8.0 jessie / wheezy unstable?
[16:55] <dephcon> bascially you're using half a disk per PG, thats a huge chunk
[16:55] <cvstealth> raw: fc20
[16:56] <dephcon> if a disk fails then you only have 1 or 2 surviving replicas for half a disk, rebuild time would be slow
[16:58] <dephcon> where as if you follow best practice and have ~100 PGs per disk, and suffer a failure the whole cluster is working to re-replicate the data
[16:58] <nils_> cvstealth: also getting max_avail on giant.
[16:58] * dugravot6 (~dugravot6@dn-infra-04.lionnois.univ-lorraine.fr) Quit (Quit: Leaving.)
[17:00] * lpabon (~quassel@24-151-54-34.dhcp.nwtn.ct.charter.com) has joined #ceph
[17:02] * davidz (~davidz@2605:e000:1313:8003:109:95b9:e1d1:ba04) Quit (Quit: Leaving.)
[17:02] * debian112 (~bcolbert@24.126.201.64) has joined #ceph
[17:05] * t0rn (~ssullivan@c-68-62-1-186.hsd1.mi.comcast.net) has joined #ceph
[17:08] * TheSov (~TheSov@64.241.45.209) has joined #ceph
[17:08] * davidz (~davidz@2605:e000:1313:8003:a0a3:d830:eee4:34d9) has joined #ceph
[17:09] <TheSov> I have a question, I'm setting up a ceph cluster to basically replace my company SAN(or at least thats the eventual goal) I'm setting it up to work with TGT, does anyone know if there is a plan to setup active multipathing with ceph?
[17:09] * TMM (~hp@sams-office-nat.tomtomgroup.com) Quit (Ping timeout: 480 seconds)
[17:12] * johanni__ (~johanni@24.4.41.97) Quit (Ping timeout: 480 seconds)
[17:12] <roland_> what is TGT?
[17:12] <raw> are there known bugs on hammer cephfs that can cause data loss? i see files with 500-5000 byte long sections of \00 bytes
[17:12] * johanni- (~johanni@24.4.41.97) Quit (Ping timeout: 480 seconds)
[17:13] <raw> those files are >30gb of size, so the there is hard to spot
[17:15] <raw> even worse. i can write a file successfully, make a md5 sum, shows correct, then drop caches, md5sum again and the file has errors
[17:15] * xENO_1 (~Kidlvr@3DDAAAN8G.tor-irc.dnsbl.oftc.net) Quit ()
[17:16] <raw> i think it is cephfs related because i have tested the same files/write pattern on a rbd image without problems
[17:16] * t0rn (~ssullivan@c-68-62-1-186.hsd1.mi.comcast.net) Quit (Ping timeout: 480 seconds)
[17:16] <raw> also tested different kernels, linux-4.0.4 and linux-3.16.7
[17:19] * t0rn (~ssullivan@c-68-62-1-186.hsd1.mi.comcast.net) has joined #ceph
[17:19] * karnan (~karnan@27.57.5.108) Quit (Quit: Leaving)
[17:20] * t0rn (~ssullivan@c-68-62-1-186.hsd1.mi.comcast.net) has left #ceph
[17:22] <nils_> smells like a bug
[17:22] * vbellur (~vijay@122.171.123.165) has joined #ceph
[17:22] <raw> also, the problem only seems to happen if im writing very fast so that disks are almost saturated
[17:22] * joshd1 (~jdurgin@68-119-140-18.dhcp.ahvl.nc.charter.com) has joined #ceph
[17:23] * johanni (~johanni@24.4.41.97) has joined #ceph
[17:23] * imjpr (~imjpr@164.111.234.201) Quit (Ping timeout: 480 seconds)
[17:24] * itsjpr (~imjpr@164.111.234.201) Quit (Ping timeout: 480 seconds)
[17:24] * raw always hits the bad bugs :(
[17:24] * johanni_ (~johanni@24.4.41.97) has joined #ceph
[17:28] * Nacer_ (~Nacer@252-87-190-213.intermediasud.com) has joined #ceph
[17:28] * Nacer_ (~Nacer@252-87-190-213.intermediasud.com) Quit (Remote host closed the connection)
[17:28] <nils_> hmm maybe you can try and force it by writing to a file and then calling sync?
[17:28] <nils_> does cephfs do O_DIRECT?
[17:29] <raw> i have tried to scrub the whole cluster to see if it is a corrution only in one copy of the data, but scrub showed nothing suspicious
[17:31] * imjpr (~imjpr@164.111.234.201) has joined #ceph
[17:32] * itsjpr (~imjpr@164.111.234.201) has joined #ceph
[17:32] * jyoti-ranjan_ (~oftc-webi@idp01webcache6-z.apj.hpecore.net) Quit (Quit: Page closed)
[17:33] * rwheeler (~rwheeler@38.140.108.3) has joined #ceph
[17:34] * dgurtner (~dgurtner@178.197.231.155) Quit (Ping timeout: 480 seconds)
[17:34] * derjohn_mob (~aj@x590e2160.dyn.telefonica.de) Quit (Ping timeout: 480 seconds)
[17:35] * Nacer (~Nacer@252-87-190-213.intermediasud.com) Quit (Ping timeout: 480 seconds)
[17:35] * angdraug (~angdraug@c-50-174-102-105.hsd1.ca.comcast.net) has joined #ceph
[17:37] * SkyEye (~gaveen@175.157.24.1) Quit (Remote host closed the connection)
[17:39] * johanni__ (~johanni@24.4.41.97) has joined #ceph
[17:39] * johanni- (~johanni@24.4.41.97) has joined #ceph
[17:40] * johanni_ (~johanni@24.4.41.97) Quit (Ping timeout: 480 seconds)
[17:42] * Hemanth (~Hemanth@121.244.87.117) Quit (Ping timeout: 480 seconds)
[17:42] * johanni (~johanni@24.4.41.97) Quit (Ping timeout: 480 seconds)
[17:45] * zaitcev (~zaitcev@2001:558:6001:10:61d7:f51f:def8:4b0f) has joined #ceph
[17:45] * _br_ (~tZ@8Q4AAA9LO.tor-irc.dnsbl.oftc.net) has joined #ceph
[17:45] * jordanP (~jordan@scality-jouf-2-194.fib.nerim.net) Quit (Quit: Leaving)
[17:46] <mtanski> nils_: yes
[17:48] * ircolle (~Adium@2601:1:a580:1735:290b:ded2:2213:cc90) has joined #ceph
[17:49] * valeech (~valeech@pool-72-86-37-215.clppva.fios.verizon.net) Quit (Quit: valeech)
[17:50] * johanni__ (~johanni@24.4.41.97) Quit (Remote host closed the connection)
[17:51] * johanni (~johanni@24.4.41.97) has joined #ceph
[17:51] * rotbeard (~redbeard@2a02:908:df10:d300:76f0:6dff:fe3b:994d) Quit (Quit: Verlassend)
[17:52] * sleinen1 (~Adium@2001:620:0:82::104) Quit (Ping timeout: 480 seconds)
[17:53] * evanjfraser (~quassel@122.252.188.1) Quit (Quit: No Ping reply in 180 seconds.)
[17:53] * evanjfraser (~quassel@122.252.188.1) has joined #ceph
[17:53] * rwheeler (~rwheeler@38.140.108.3) Quit (Quit: Leaving)
[17:55] * johanni- (~johanni@24.4.41.97) Quit (Ping timeout: 480 seconds)
[17:56] * xarses (~andreww@172.56.16.196) has joined #ceph
[17:57] <nils_> This accelio RDMA stuff certainly looks interesting
[17:59] * johanni (~johanni@24.4.41.97) Quit (Ping timeout: 480 seconds)
[18:00] * kefu (~kefu@114.92.116.93) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[18:02] * moore (~moore@64.202.160.88) has joined #ceph
[18:02] * thomnico (~thomnico@2a01:e35:8b41:120:882b:f95f:f73:b556) Quit (Quit: Ex-Chat)
[18:03] * bene (~ben@nat-pool-bos-t.redhat.com) has joined #ceph
[18:05] * bene2 (~ben@nat-pool-bos-t.redhat.com) Quit (Ping timeout: 480 seconds)
[18:06] * thomnico (~thomnico@2a01:e35:8b41:120:882b:f95f:f73:b556) has joined #ceph
[18:07] * sleinen (~Adium@dsl2.puzzle.ch) has joined #ceph
[18:08] * daviddcc (~dcasier@LCaen-656-1-144-187.w217-128.abo.wanadoo.fr) has joined #ceph
[18:15] * johanni (~johanni@173.226.103.101) has joined #ceph
[18:15] * _br_ (~tZ@8Q4AAA9LO.tor-irc.dnsbl.oftc.net) Quit ()
[18:15] * johanni_ (~johanni@173.226.103.101) has joined #ceph
[18:17] * kawa2014 (~kawa@89.184.114.246) Quit (Quit: Leaving)
[18:18] * jordanP (~jordan@her75-2-78-193-36-209.fbxo.proxad.net) has joined #ceph
[18:19] * jordanP (~jordan@her75-2-78-193-36-209.fbxo.proxad.net) Quit ()
[18:19] * kawa2014 (~kawa@212.110.41.244) has joined #ceph
[18:27] <sugoruyo> dephcon: that's one of the issues I'm bringing up, but we are using EC with 8+3 rather than replication so that changes things from your argument
[18:28] <sugoruyo> we don't have a "cluster" network in place and won't for some time so I don't want to have 100 PGs/OSD (seems like there might be too much traffic between them)
[18:28] <raw> im now downgrading from hammer to giant to see if the cephfs file corruption bug also happens there
[18:30] * nsoffer (~nsoffer@bzq-79-177-255-248.red.bezeqint.net) has joined #ceph
[18:31] * johanni (~johanni@173.226.103.101) Quit (Remote host closed the connection)
[18:32] * yguang11 (~yguang11@nat-dip30-wl-d.cfw-a-gci.corp.yahoo.com) has joined #ceph
[18:33] * johanni (~johanni@173.226.103.101) has joined #ceph
[18:35] * erice (~eric@50.245.231.209) has joined #ceph
[18:36] * thomnico (~thomnico@2a01:e35:8b41:120:882b:f95f:f73:b556) Quit (Quit: Ex-Chat)
[18:39] * jyoti_ranjan (~ranjanj@idp01webcache6-z.apj.hpecore.net) has joined #ceph
[18:39] * jyoti-ranjan (~ranjanj@idp01webcache6-z.apj.hpecore.net) Quit (Read error: Connection reset by peer)
[18:40] * jyoti_ranjan (~ranjanj@idp01webcache6-z.apj.hpecore.net) Quit (Read error: Connection reset by peer)
[18:40] * jyoti-ranjan (~ranjanj@idp01webcache6-z.apj.hpecore.net) has joined #ceph
[18:40] * Concubidated (~Adium@71.21.5.251) has joined #ceph
[18:45] * Pommesgabel (~richardus@104.238.174.29) has joined #ceph
[18:46] * midnightrunner (~midnightr@216.113.160.65) has joined #ceph
[18:47] <TheSov> roland_, iSCSI tgt
[18:49] * bandrus (~brian@44.sub-70-211-71.myvzw.com) has joined #ceph
[18:51] * midnight_ (~midnightr@216.113.160.71) has joined #ceph
[18:51] <mongo> raw: make sure your are not seeing kernel buffer issues?
[18:53] <raw> mongo, how? when i have just written the file, it is in the kernel buffer. if i md5sum at this time, the checksum matches. if i do a "echo 3 > /proc/sys/vm/drop_caches" and checksum the same file again, the checksum is wrong.
[18:54] * linjan (~linjan@80.179.241.26) has joined #ceph
[18:54] <raw> also if i checksum the file from another node, the checksum shows the same (wrong) value
[18:54] * odi (~quassel@2a00:12c0:1015:136::9) Quit (Remote host closed the connection)
[18:54] * midnightrunner (~midnightr@216.113.160.65) Quit (Ping timeout: 480 seconds)
[18:55] * egroj (~egroj@190.210.0.229) has joined #ceph
[18:55] * sleinen (~Adium@dsl2.puzzle.ch) Quit (Quit: Leaving.)
[18:55] * egroj (~egroj@190.210.0.229) has left #ceph
[18:55] * johanni (~johanni@173.226.103.101) Quit (Remote host closed the connection)
[18:55] * egroj (~egroj@190.210.0.229) has joined #ceph
[18:56] * egroj (~egroj@190.210.0.229) Quit ()
[18:58] * odi (~quassel@2a00:12c0:1015:136::9) has joined #ceph
[18:59] * cholcombe (~chris@c-73-180-29-35.hsd1.or.comcast.net) has joined #ceph
[19:01] * ChrisNBlum (~ChrisNBlu@dhcp-ip-190.dorf.rwth-aachen.de) has joined #ceph
[19:02] <mongo> raw: I saw a similar issue with a disk that went into internal error correct mode with silly large net.core.wmem_max and net.core.rmem_max
[19:02] * johanni_ (~johanni@173.226.103.101) Quit (Ping timeout: 480 seconds)
[19:02] * nils_ (~nils@doomstreet.collins.kg) Quit (Quit: This computer has gone to sleep)
[19:03] * kawa2014 (~kawa@212.110.41.244) Quit (Quit: Leaving)
[19:04] <mongo> setting sane values and setting vm.min_free_kbytes fixed it but a quick grep "page allocation failure" in /var/log/syslog
[19:04] <mongo> should rule it out.
[19:04] * moore (~moore@64.202.160.88) Quit (Remote host closed the connection)
[19:05] * ChrisNBlum (~ChrisNBlu@dhcp-ip-190.dorf.rwth-aachen.de) Quit ()
[19:05] * bitserker (~toni@88.87.194.130) Quit (Ping timeout: 480 seconds)
[19:07] * johanni (~johanni@173.226.103.101) has joined #ceph
[19:07] * mykola (~Mikolaj@91.225.200.209) has joined #ceph
[19:07] * johanni_ (~johanni@173.226.103.101) has joined #ceph
[19:09] * jyoti-ranjan (~ranjanj@idp01webcache6-z.apj.hpecore.net) Quit (Read error: Connection reset by peer)
[19:11] * egroj (~egroj@190.210.0.229) has joined #ceph
[19:11] * KevinPerks (~Adium@nat-pool-rdu-t.redhat.com) has joined #ceph
[19:14] * circ-user-8kpRm (~circuser-@190.210.0.229) has joined #ceph
[19:15] * egroj (~egroj@190.210.0.229) Quit ()
[19:15] * Pommesgabel (~richardus@3DDAAAOEV.tor-irc.dnsbl.oftc.net) Quit ()
[19:15] * Hazmat (~Tonux@89.105.194.79) has joined #ceph
[19:23] * sjm (~sjm@65.115.226.27) has joined #ceph
[19:24] * haomaiwa_ (~haomaiwan@114.111.166.250) has joined #ceph
[19:24] * oro (~oro@84-72-20-79.dclient.hispeed.ch) Quit (Ping timeout: 480 seconds)
[19:24] * haomaiwang (~haomaiwan@114.111.166.250) Quit (Ping timeout: 480 seconds)
[19:28] * daviddcc loicd Hello Loic
[19:29] <daviddcc> Les videos dont tu m'avais parl?, c'est du genre : https://www.youtube.com/watch?v=2_qqwE8S6f4 ?
[19:30] * derjohn_mob (~aj@tmo-111-165.customers.d1-online.com) has joined #ceph
[19:30] * daviddcc loicd Les videos dont tu m'avais parl?, c'est du genre : https://www.youtube.com/watch?v=2_qqwE8S6f4 ?
[19:31] <daviddcc> Sorry for this post error
[19:31] <loicd> daviddcc: it showed as *****, don't worry
[19:32] <loicd> daviddcc: yes, these are CDS videos, quite interesting to watch
[19:34] * cdelatte (~cdelatte@cpe-172-72-105-98.carolina.res.rr.com) has joined #ceph
[19:34] <daviddcc> In the futur, i made a blog with a different approach on the Ceph block storage
[19:35] <daviddcc> *will make
[19:35] * ChrisNBlum (~ChrisNBlu@dhcp-ip-190.dorf.rwth-aachen.de) has joined #ceph
[19:37] * ChrisNBl_ (~ChrisNBlu@dhcp-ip-230.dorf.rwth-aachen.de) has joined #ceph
[19:38] * delattec (~cdelatte@cpe-172-72-105-98.carolina.res.rr.com) Quit (Ping timeout: 480 seconds)
[19:38] * delattec (~cdelatte@cpe-172-72-105-98.carolina.res.rr.com) has joined #ceph
[19:38] * Sysadmin88 (~IceChat77@054527d3.skybroadband.com) has joined #ceph
[19:39] * imjpr (~imjpr@164.111.234.201) Quit (Ping timeout: 480 seconds)
[19:40] * itsjpr (~imjpr@164.111.234.201) Quit (Ping timeout: 480 seconds)
[19:40] * moore (~moore@fw125-01-outside-active.ent.mgmt.glbt1.secureserver.net) has joined #ceph
[19:41] <raw> mongo, i have no sysctl.conf settings, all default.
[19:42] <raw> the ssds im using are almost brand new
[19:42] * georgem (~Adium@fwnat.oicr.on.ca) Quit (Read error: Connection reset by peer)
[19:42] * georgem (~Adium@fwnat.oicr.on.ca) has joined #ceph
[19:42] * cdelatte (~cdelatte@cpe-172-72-105-98.carolina.res.rr.com) Quit (Ping timeout: 480 seconds)
[19:44] * ChrisNBlum (~ChrisNBlu@dhcp-ip-190.dorf.rwth-aachen.de) Quit (Ping timeout: 480 seconds)
[19:45] * haomaiwa_ (~haomaiwan@114.111.166.250) Quit (Ping timeout: 480 seconds)
[19:45] * Hazmat (~Tonux@3DDAAAOG5.tor-irc.dnsbl.oftc.net) Quit ()
[19:47] * haomaiwang (~haomaiwan@114.111.166.250) has joined #ceph
[19:47] * xarses (~andreww@172.56.16.196) Quit (Remote host closed the connection)
[19:50] * fdmanana__ (~fdmanana@bl13-138-253.dsl.telepac.pt) Quit (Ping timeout: 480 seconds)
[19:52] <daviddcc> osd: tier: fine-grained promotion unit is applied ?
[19:54] * TMM (~hp@178-84-46-106.dynamic.upc.nl) has joined #ceph
[19:55] * georgem (~Adium@fwnat.oicr.on.ca) has left #ceph
[19:57] * johanni_ (~johanni@173.226.103.101) Quit (Read error: Connection reset by peer)
[19:57] * johanni (~johanni@173.226.103.101) Quit (Read error: Connection reset by peer)
[20:00] * fdmanana__ (~fdmanana@bl13-138-253.dsl.telepac.pt) has joined #ceph
[20:00] * moore (~moore@fw125-01-outside-active.ent.mgmt.glbt1.secureserver.net) Quit (Remote host closed the connection)
[20:03] * bandrus1 (~brian@44.sub-70-211-71.myvzw.com) has joined #ceph
[20:06] * bandrus (~brian@44.sub-70-211-71.myvzw.com) Quit (Ping timeout: 480 seconds)
[20:07] * itsjpr (~imjpr@138.26.125.8) has joined #ceph
[20:07] * imjpr (~imjpr@thing2.it.uab.edu) has joined #ceph
[20:09] * bene (~ben@nat-pool-bos-t.redhat.com) Quit (Quit: Konversation terminated!)
[20:10] * haomaiwa_ (~haomaiwan@114.111.166.250) has joined #ceph
[20:11] * bandrus1 (~brian@44.sub-70-211-71.myvzw.com) Quit (Ping timeout: 480 seconds)
[20:14] * haomaiwang (~haomaiwan@114.111.166.250) Quit (Ping timeout: 480 seconds)
[20:15] * Epi (~xolotl@8Q4AAA9RP.tor-irc.dnsbl.oftc.net) has joined #ceph
[20:23] * tupper (~tcole@2001:420:2280:1272:8900:f9b8:3b49:567e) Quit (Ping timeout: 480 seconds)
[20:25] * bandrus (~brian@55.sub-70-214-35.myvzw.com) has joined #ceph
[20:27] <rlrevell> tw0fish: you there?
[20:29] * sleinen (~Adium@vpn-ho-d-130.switch.ch) has joined #ceph
[20:31] * LeaChim (~LeaChim@host86-163-124-72.range86-163.btcentralplus.com) has joined #ceph
[20:35] * TMM (~hp@178-84-46-106.dynamic.upc.nl) Quit (Ping timeout: 480 seconds)
[20:37] * TMM (~hp@178-84-46-106.dynamic.upc.nl) has joined #ceph
[20:38] * sleinen (~Adium@vpn-ho-d-130.switch.ch) Quit (Ping timeout: 480 seconds)
[20:41] * sleinen (~Adium@194.230.155.168) has joined #ceph
[20:42] * nsoffer (~nsoffer@bzq-79-177-255-248.red.bezeqint.net) Quit (Ping timeout: 480 seconds)
[20:45] * Epi (~xolotl@8Q4AAA9RP.tor-irc.dnsbl.oftc.net) Quit ()
[20:45] * Mattress (~Kyso_@ncc-1701-a.tor-exit.network) has joined #ceph
[20:45] * Hemanth (~Hemanth@117.192.231.76) has joined #ceph
[20:50] * ngoswami (~ngoswami@121.244.87.116) Quit (Quit: Leaving)
[20:52] <tw0fish> rlrevell: hey, what's up?
[20:52] * vikhyat (~vumrao@49.248.86.226) has joined #ceph
[20:52] <rlrevell> tw0fish: nvm, i figured it out. ended up with a bunch of undeletable S3 buckets, finally figured out the equivalent of rm -rf * as root
[20:53] <tw0fish> rlrevell: i got all of my stuff working yeseterday. i found the problem with the ceph-radosgw script.
[20:53] <rlrevell> cool
[20:53] <tw0fish> they have a line in here that says if you aren't running the radsogw on a unix socket, make it exit 1 and fail. :(
[20:54] <tw0fish> i created a couple of buckets on the gateway i have with s3
[20:55] <tw0fish> # is the socket defined? if it's not, this instance shouldn't run as a daemon.
[20:55] <tw0fish> #rgw_socket=`$RADOSGW -n $name --show-config-value rgw_socket_path`
[20:55] <tw0fish> basically comment that out
[20:55] <tw0fish> the instance runs just fine as a daemon w/o a socket using a TCP port.
[20:55] * ChrisNBl_ (~ChrisNBlu@dhcp-ip-230.dorf.rwth-aachen.de) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[20:56] * rotbeard (~redbeard@2a02:908:df10:d300:76f0:6dff:fe3b:994d) has joined #ceph
[20:56] * ChrisNBlum (~ChrisNBlu@dhcp-ip-230.dorf.rwth-aachen.de) has joined #ceph
[20:56] <tw0fish> do you have to use Python boto to delete and add stuff on Amazon S3?
[20:57] <tw0fish> they have this API script I used to test my gw, but since you aren't running your own gw, not sure how that works.
[20:58] <ganders> is CentOS Linux Core 7.1.1503 supported?
[20:59] <rlrevell> tw0fish: i have been using stuff like http://ceph.com/docs/master/radosgw/s3/python/
[20:59] <tw0fish> ganders loosely, with some hacking it works. well i am speaking to RHEL 7 when i say that.
[20:59] <tw0fish> ganders: problems i ran into are the systemd scripts.
[20:59] <tw0fish> but i got that sorted out
[20:59] <rlrevell> tw0fish: started with the http://ceph.com/docs/master/radosgw/config/#access-verification script
[20:59] <tw0fish> rlrevell: cool, that is exactly what i used to test mine.
[20:59] <tw0fish> that python script that uses boto
[21:00] * sjm (~sjm@65.115.226.27) Quit (Ping timeout: 480 seconds)
[21:00] <ganders> tw0fish: it fails with the ceph-deploy install... :(
[21:00] <ganders> [ceph_deploy][ERROR ] UnsupportedPlatform: Platform is not supported: CentOS Linux Core 7.1.1503
[21:00] <tw0fish> ganders: no. actually it works well with everything else except when you get into setting up the gateway stuff.
[21:01] <rlrevell> i would be interested to see how many of these test your gateway passeshttps://github.com/ceph/s3-tests. i have mine to where it only fails 3, but since the radosgw only claims to implement most S3 functionality i don't know if this is normal
[21:01] <tw0fish> rlrevell: i found out that we can use hammer. the only reason why i was asked to use giant is because that was the latest at the time. i didn't realize a new ver of Ceph comes out every 6 monhts. :(
[21:01] <tw0fish> rlrevell: that is going to suck having to upgrade ceph every 6 mo. hopefully an upgrade doesn't require bringing down the entire cluste.r
[21:01] * daviddcc (~dcasier@LCaen-656-1-144-187.w217-128.abo.wanadoo.fr) Quit (Ping timeout: 480 seconds)
[21:02] <loicd> FYI : http://stackoverflow.com/questions/30647431/ceph-list-object-in-a-rados-block-device
[21:03] <ganders> is there a way to 'bypass' that check and continue with the ceph-deploy command?
[21:05] <rlrevell> tw0fish: actually, 8 fail, 3 error, not sure what the difference is ;-)
[21:06] <rlrevell> tw0fish: i wouldn't upgrade until the next point release anyway, supposed to be soon
[21:06] * vikhyat (~vumrao@49.248.86.226) Quit (Quit: Leaving)
[21:07] <Teduardo> woah there is discussion in here, i thought the community was done
[21:07] <Teduardo> for ceph
[21:07] <tw0fish> ganders: i didn't run into that problem there, but i am using RHEL 7.
[21:07] * blueskin_ (~a@ks28333.kimsufi.com) Quit (Quit: leaving)
[21:08] <tw0fish> ganders: i did read it works for centos 7, somewhere.
[21:08] <tw0fish> rlrevell: i can try to do some testing
[21:08] * sleinen (~Adium@194.230.155.168) Quit (Quit: Leaving.)
[21:09] * TMM (~hp@178-84-46-106.dynamic.upc.nl) Quit (Quit: Ex-Chat)
[21:11] * TMM (~hp@178-84-46-106.dynamic.upc.nl) has joined #ceph
[21:11] * ganders (~root@190.2.42.21) Quit (Quit: WeeChat 0.4.2)
[21:13] * TMM (~hp@178-84-46-106.dynamic.upc.nl) Quit ()
[21:15] * Mattress (~Kyso_@9S0AAAM7O.tor-irc.dnsbl.oftc.net) Quit ()
[21:15] * CorneliousJD|AtWork (~Tralin|Sl@ns378106.ip-37-59-41.eu) has joined #ceph
[21:16] * TMM (~hp@178-84-46-106.dynamic.upc.nl) has joined #ceph
[21:24] * Concubidated (~Adium@71.21.5.251) Quit (Quit: Leaving.)
[21:27] * moore (~moore@64.202.160.88) has joined #ceph
[21:31] * wicope (~wicope@0001fd8a.user.oftc.net) has joined #ceph
[21:31] * wicope (~wicope@0001fd8a.user.oftc.net) Quit (Max SendQ exceeded)
[21:32] * georgem (~Adium@fwnat.oicr.on.ca) has joined #ceph
[21:34] * calvinx (~calvin@101.100.172.246) Quit (Quit: calvinx)
[21:38] * dmick (~dmick@206.169.83.146) has joined #ceph
[21:38] * tupper (~tcole@173.38.117.76) has joined #ceph
[21:43] * Nacer (~Nacer@203-206-190-109.dsl.ovh.fr) has joined #ceph
[21:43] * fdmanana__ (~fdmanana@bl13-138-253.dsl.telepac.pt) Quit (Ping timeout: 480 seconds)
[21:45] * CorneliousJD|AtWork (~Tralin|Sl@9S0AAAM9D.tor-irc.dnsbl.oftc.net) Quit ()
[21:45] * QuantumBeep (~Borf@chulak.enn.lu) has joined #ceph
[21:45] * treenerd (~treenerd@cpe90-146-100-181.liwest.at) has joined #ceph
[21:50] * fdmanana__ (~fdmanana@bl13-138-253.dsl.telepac.pt) has joined #ceph
[21:52] <seapasulli> anyone know where I can find a good set of docs for what each of the columns in an osd.log or mon.log are? Or how they are constructed in general?
[21:53] * ismell_ (~ismell@host-64-17-88-252.beyondbb.com) has joined #ceph
[21:55] * daviddcc (~dcasier@77.151.197.84) has joined #ceph
[22:00] * ismell (~ismell@host-64-17-89-242.beyondbb.com) Quit (Ping timeout: 480 seconds)
[22:01] * tw0fish (~tw0fish@UNIX3.ANDREW.CMU.EDU) Quit (Quit: leaving)
[22:05] * fdmanana__ (~fdmanana@bl13-138-253.dsl.telepac.pt) Quit (Ping timeout: 480 seconds)
[22:05] <seapasulli> "pipe(0x2614c580 sd=110 :6916 s=2 pgs=8774 cs=47 l=0 c=0x162ea940)" for instance what does each column here mean?
[22:05] * dephcon (~oftc-webi@c73-110.rim.net) Quit (Quit: Page closed)
[22:13] * KindOne (kindone@0001a7db.user.oftc.net) Quit (Quit: Hiring PHP developers does not contribute to the quota of employees with disabilities.)
[22:13] <dmick> no docs I'm aware of other than the source
[22:13] <dmick> those are mostly "<<" operators for the various data types that are logged, I can tell you that much
[22:14] * KevinPerks1 (~Adium@nat-pool-rdu-t.redhat.com) has joined #ceph
[22:15] * KevinPerks (~Adium@nat-pool-rdu-t.redhat.com) Quit (Read error: Connection reset by peer)
[22:15] * QuantumBeep (~Borf@9S0AAANAU.tor-irc.dnsbl.oftc.net) Quit ()
[22:15] * Maariu5_ (~Guest1390@9S0AAANCJ.tor-irc.dnsbl.oftc.net) has joined #ceph
[22:16] * KindOne (kindone@0001a7db.user.oftc.net) has joined #ceph
[22:20] * KevinPerks (~Adium@nat-pool-rdu-t.redhat.com) has joined #ceph
[22:20] * KevinPerks1 (~Adium@nat-pool-rdu-t.redhat.com) Quit (Read error: Connection reset by peer)
[22:22] * jrankin (~jrankin@d53-64-170-236.nap.wideopenwest.com) Quit (Quit: Leaving)
[22:23] * KevinPerks (~Adium@nat-pool-rdu-t.redhat.com) Quit (Read error: Connection reset by peer)
[22:23] * KevinPerks (~Adium@nat-pool-rdu-t.redhat.com) has joined #ceph
[22:29] * fridim_ (~fridim@56-198-190-109.dsl.ovh.fr) Quit (Ping timeout: 480 seconds)
[22:32] * c4tech (~c4tech@199.91.185.156) has joined #ceph
[22:33] * c4tech (~c4tech@199.91.185.156) Quit ()
[22:33] <seapasulli> ah of course the source :3
[22:35] * Hemanth (~Hemanth@117.192.231.76) Quit (Ping timeout: 480 seconds)
[22:36] * TheSov (~TheSov@64.241.45.209) Quit (Quit: Leaving)
[22:38] * dyasny (~dyasny@173.231.115.59) Quit (Ping timeout: 480 seconds)
[22:43] * mykola (~Mikolaj@91.225.200.209) Quit (Quit: away)
[22:43] * linjan (~linjan@80.179.241.26) Quit (Ping timeout: 480 seconds)
[22:44] * Concubidated (~Adium@66.87.66.104) has joined #ceph
[22:45] * Maariu5_ (~Guest1390@9S0AAANCJ.tor-irc.dnsbl.oftc.net) Quit ()
[22:45] * cyphase (~Kyso_@192.42.116.16) has joined #ceph
[22:46] * cyphase is now known as Guest594
[22:46] * rlrevell (~leer@vbo1.inmotionhosting.com) Quit (Ping timeout: 480 seconds)
[22:48] * jdillaman (~jdillaman@pool-108-18-97-82.washdc.fios.verizon.net) Quit (Quit: jdillaman)
[22:51] * treenerd (~treenerd@cpe90-146-100-181.liwest.at) Quit (Quit: Verlassend)
[22:53] * ira (~ira@c-71-233-225-22.hsd1.ma.comcast.net) has joined #ceph
[22:58] * sleinen (~Adium@2001:620:0:82::100) has joined #ceph
[23:02] * imjustmatthew (~imjustmat@pool-74-110-227-240.rcmdva.fios.verizon.net) has joined #ceph
[23:08] * tupper (~tcole@173.38.117.76) Quit (Ping timeout: 480 seconds)
[23:08] * jskinner (~jskinner@host-95-2-129.infobunker.com) Quit (Remote host closed the connection)
[23:10] * martineg (~martin@shell01.copyleft.no) Quit (Remote host closed the connection)
[23:11] * circ-user-8kpRm (~circuser-@190.210.0.229) Quit (Remote host closed the connection)
[23:14] * KevinPerks (~Adium@nat-pool-rdu-t.redhat.com) Quit (Quit: Leaving.)
[23:15] * Guest594 (~Kyso_@8Q4AAA9WG.tor-irc.dnsbl.oftc.net) Quit ()
[23:15] * Deiz (~slowriot@9S0AAANFX.tor-irc.dnsbl.oftc.net) has joined #ceph
[23:17] * georgem (~Adium@fwnat.oicr.on.ca) Quit (Quit: Leaving.)
[23:18] * ChrisNBlum (~ChrisNBlu@dhcp-ip-230.dorf.rwth-aachen.de) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[23:25] * sjm (~sjm@2607:fb90:a96:b146:c95d:78f6:2267:4a94) has joined #ceph
[23:30] * angdraug (~angdraug@c-50-174-102-105.hsd1.ca.comcast.net) Quit (Quit: Leaving)
[23:32] * Nacer_ (~Nacer@203-206-190-109.dsl.ovh.fr) has joined #ceph
[23:32] * Nacer (~Nacer@203-206-190-109.dsl.ovh.fr) Quit (Read error: Connection reset by peer)
[23:35] * DV_ (~veillard@2001:41d0:a:f29f::1) Quit (Ping timeout: 480 seconds)
[23:35] * itsjpr (~imjpr@138.26.125.8) Quit (Ping timeout: 480 seconds)
[23:35] * imjpr (~imjpr@thing2.it.uab.edu) Quit (Ping timeout: 480 seconds)
[23:39] * dneary (~dneary@nat-pool-bos-u.redhat.com) Quit (Remote host closed the connection)
[23:39] * jskinner (~jskinner@host-95-2-129.infobunker.com) has joined #ceph
[23:40] * lpabon (~quassel@24-151-54-34.dhcp.nwtn.ct.charter.com) Quit (Ping timeout: 480 seconds)
[23:43] * stiopa (~stiopa@cpc73828-dals21-2-0-cust630.20-2.cable.virginm.net) has joined #ceph
[23:45] * moore (~moore@64.202.160.88) Quit (Remote host closed the connection)
[23:45] * Deiz (~slowriot@9S0AAANFX.tor-irc.dnsbl.oftc.net) Quit ()
[23:45] * Thayli (~Miho@static-ip-85-25-103-119.inaddr.ip-pool.com) has joined #ceph
[23:47] * sjm (~sjm@2607:fb90:a96:b146:c95d:78f6:2267:4a94) has left #ceph
[23:47] * DV_ (~veillard@2001:41d0:1:d478::1) has joined #ceph
[23:48] * Cybert1nus (~Cybertinu@cybertinus.customer.cloud.nl) Quit (Remote host closed the connection)
[23:50] * Cybertinus (~Cybertinu@cybertinus.customer.cloud.nl) has joined #ceph
[23:50] * jskinner (~jskinner@host-95-2-129.infobunker.com) Quit (Remote host closed the connection)
[23:52] * jskinner (~jskinner@host-95-2-129.infobunker.com) has joined #ceph
[23:53] * angdraug (~angdraug@12.164.168.117) has joined #ceph
[23:56] * brad_mssw (~brad@66.129.88.50) Quit (Quit: Leaving)
[23:57] * sleinen1 (~Adium@84-72-160-233.dclient.hispeed.ch) has joined #ceph
[23:58] * sleinen1 (~Adium@84-72-160-233.dclient.hispeed.ch) Quit ()
[23:58] * sleinen1 (~Adium@84-72-160-233.dclient.hispeed.ch) has joined #ceph

These logs were automatically created by CephLogBot on irc.oftc.net using the Java IRC LogBot.