#ceph IRC Log

Index

IRC Log for 2013-05-11

Timestamps are in GMT/BST.

[0:01] * PerlStalker (~PerlStalk@72.166.192.70) Quit (Quit: ...)
[0:01] * BillK (~BillK@124-169-231-135.dyn.iinet.net.au) has joined #ceph
[0:12] * portante is now known as portante|afk
[0:13] * BillK (~BillK@124-169-231-135.dyn.iinet.net.au) Quit (Quit: Leaving)
[0:16] * jjgalvez (~jjgalvez@cpe-76-175-30-67.socal.res.rr.com) has joined #ceph
[0:35] * wschulze (~wschulze@cpe-69-203-80-81.nyc.res.rr.com) has joined #ceph
[0:35] * DarkAce-Z (~BillyMays@50.107.54.92) has joined #ceph
[0:38] * DarkAceZ (~BillyMays@50.107.54.92) Quit (Ping timeout: 480 seconds)
[0:46] * leseb (~Adium@bea13-1-82-228-104-16.fbx.proxad.net) has joined #ceph
[1:12] * leseb (~Adium@bea13-1-82-228-104-16.fbx.proxad.net) Quit (Quit: Leaving.)
[1:15] * Cube (~Cube@12.248.40.138) Quit (Ping timeout: 480 seconds)
[1:26] * tkensiski (~tkensiski@209.66.64.134) has joined #ceph
[1:26] * tkensiski (~tkensiski@209.66.64.134) has left #ceph
[1:30] * jlogan (~Thunderbi@2600:c00:3010:1:1::40) Quit (Ping timeout: 480 seconds)
[1:31] * tnt_ (~tnt@91.177.214.32) Quit (Ping timeout: 480 seconds)
[1:36] * loicd (~loic@magenta.dachary.org) Quit (Quit: Leaving.)
[1:36] * loicd (~loic@magenta.dachary.org) has joined #ceph
[1:39] * jlogan (~Thunderbi@2600:c00:3010:1:1::40) has joined #ceph
[1:51] * esammy (~esamuels@host-2-103-103-135.as13285.net) Quit (Quit: esammy)
[1:54] * alram (~alram@38.122.20.226) Quit (Quit: leaving)
[2:08] * netmass (~oftc-webi@107-206-68-146.lightspeed.rcsntx.sbcglobal.net) has joined #ceph
[2:09] * rturk is now known as rturk-away
[2:10] <netmass> Evening... have a test cluster running Cuttlefish 6.1.1 and had a working ubuntu cephfs client running kernel 3.9.9. Brought up a centos 6 box with kernel 3.9.1 and can only mount the cephfs read-only. What obvious thing am I missing? Thoughts appreciated...
[2:27] * nlopes (~nlopes@a95-92-0-12.cpe.netcabo.pt) Quit (Quit: leaving)
[2:30] * netmass (~oftc-webi@107-206-68-146.lightspeed.rcsntx.sbcglobal.net) Quit (Quit: Page closed)
[2:30] * nlopes (~nlopes@a95-92-0-12.cpe.netcabo.pt) has joined #ceph
[2:43] * DarkAce-Z (~BillyMays@50.107.54.92) Quit (Ping timeout: 480 seconds)
[2:48] * themgt (~themgt@24-177-232-33.dhcp.gnvl.sc.charter.com) Quit (Quit: themgt)
[2:49] * DarkAce-Z (~BillyMays@50.107.54.92) has joined #ceph
[2:54] * themgt (~themgt@24-177-232-33.dhcp.gnvl.sc.charter.com) has joined #ceph
[2:59] * Tamil (~tamil@38.122.20.226) Quit (Quit: Leaving.)
[3:05] * wschulze (~wschulze@cpe-69-203-80-81.nyc.res.rr.com) Quit (Quit: Leaving.)
[3:06] * frank9999 (~frank@kantoor.transip.nl) Quit (Read error: Connection reset by peer)
[3:23] * JohansGlock_ (~quassel@kantoor.transip.nl) has joined #ceph
[3:26] * jmlowe (~Adium@c-71-201-31-207.hsd1.in.comcast.net) has joined #ceph
[3:26] * ninkotech__ (~duplo@static-84-242-87-186.net.upcbroadband.cz) has joined #ceph
[3:26] * ninkotech (~duplo@static-84-242-87-186.net.upcbroadband.cz) Quit (Read error: Connection reset by peer)
[3:30] * JohansGlock (~quassel@kantoor.transip.nl) Quit (Ping timeout: 480 seconds)
[3:31] * wschulze (~wschulze@cpe-69-203-80-81.nyc.res.rr.com) has joined #ceph
[3:31] * KindOne (KindOne@0001a7db.user.oftc.net) Quit (Ping timeout: 480 seconds)
[3:37] * KindTwo (KindOne@h240.35.28.71.dynamic.ip.windstream.net) has joined #ceph
[3:41] * KindTwo is now known as KindOne
[3:49] * rustam (~rustam@94.15.91.30) Quit (Remote host closed the connection)
[3:49] * wschulze (~wschulze@cpe-69-203-80-81.nyc.res.rr.com) Quit (Quit: Leaving.)
[3:49] * wschulze (~wschulze@cpe-69-203-80-81.nyc.res.rr.com) has joined #ceph
[3:50] * rustam (~rustam@94.15.91.30) has joined #ceph
[3:50] * rustam (~rustam@94.15.91.30) Quit (Remote host closed the connection)
[4:01] * john_barbee_ (~jbarbee@c-98-226-73-253.hsd1.in.comcast.net) has joined #ceph
[4:07] * dosaboy_ (~dosaboy@host86-161-206-107.range86-161.btcentralplus.com) has joined #ceph
[4:07] * dosaboy (~dosaboy@host86-161-206-107.range86-161.btcentralplus.com) Quit (Read error: Connection reset by peer)
[4:08] * DarkAce-Z (~BillyMays@50.107.54.92) Quit (Ping timeout: 480 seconds)
[4:12] * rustam (~rustam@94.15.91.30) has joined #ceph
[4:14] * rustam (~rustam@94.15.91.30) Quit (Remote host closed the connection)
[4:15] * diegows (~diegows@190.190.2.126) Quit (Ping timeout: 480 seconds)
[4:27] * themgt (~themgt@24-177-232-33.dhcp.gnvl.sc.charter.com) Quit (Quit: themgt)
[4:35] * wschulze (~wschulze@cpe-69-203-80-81.nyc.res.rr.com) Quit (Quit: Leaving.)
[4:42] * portante|afk (~user@66.187.233.206) Quit (Remote host closed the connection)
[4:43] * portante|afk (~user@66.187.233.206) has joined #ceph
[4:51] <mikedawson> Anyone running 0.61.1: watch out for a disk usage due to a file called /var/log/ceph/ceph-mon.<mon-name>.tdump. This is a debugging tool that was enabled (imho) incorrectly. It is not necessary. To disable it, add "mon debug dump transactions = false" and restart your monitors
[4:53] * denken (~denken@dione.pixelchaos.net) has joined #ceph
[4:57] <dmick> hm. that doesn't sound right/
[4:59] * nhm_ (~nhm@184-97-193-157.mpls.qwest.net) has joined #ceph
[5:01] <mikedawson> dmick: agreed. Perhaps it was merged in accidentally
[5:02] <dmick> oh I think Sam just made the wrong default choice. I'll file an issue
[5:02] <mikedawson> http://ceph.com/git/?p=ceph.git;a=blobdiff;f=src/common/config_opts.h;h=bb0fea66604962978b72390e35dff0855d53dc5d;hp=687dea107a2d369e90a83da2db4fda883eb3f45c;hb=797089ef082b99910eebfd9454c03d1f027c93bb;hpb=9e11065f0caff748cdfb758c0eeef6b60e2ac0fa
[5:02] <dmick> yep
[5:03] <dmick> 797089ef082b99910eebfd9454c03d1f027c93bb
[5:03] <mikedawson> dmick: be advised I burned over 100GB on my mons
[5:03] <dmick> oh dear
[5:03] <dmick> so this is rather urgent
[5:03] <nigwil> my .tdump has reached 3.4GB :-)
[5:03] <dmick> and probably needs an email
[5:03] <dmick> thanks for letting us know
[5:03] <dmick> amusingly of course, it was added for you :)
[5:04] <mikedawson> so I bet by the time Monday rolls around it'll be an epidemic for people with smallish partitions
[5:04] <mikedawson> dmick: the irony isn't lost on me :-)
[5:05] <nigwil> there is no CLI option to switch the debug transactions off?
[5:05] <mikedawson> dmick, do you want me to write the email or do you?
[5:05] <dmick> mikedawson: you can write it if you like; hold just 1 min and I'll give you the issue URL to include
[5:05] * nhm (~nhm@65-128-150-185.mpls.qwest.net) Quit (Ping timeout: 480 seconds)
[5:05] <mikedawson> nigwil: you can inject the arg, or add it to ceph.conf then restart the mon
[5:06] <dmick> nigwil: you can set that option in any standard way (.conf file, -- on the cmdline, inject)
[5:06] <dmick> in fact
[5:07] <nigwil> thanks, didn't know about injectargs
[5:07] <dmick> this may be bad enough that I might just push a branch fix so gitbuilder will create a package set
[5:07] <dmick> http://tracker.ceph.com/issues/5024
[5:10] <nigwil> something like this? ceph mon tell '*' injectargs '--dump_transactions 0'
[5:11] <nigwil> should it stop growing as soon as they are told?
[5:11] <dmick> name will be mon_debug_dump_transactions
[5:11] * todin (tuxadero@kudu.in-berlin.de) Quit (Ping timeout: 480 seconds)
[5:11] <nigwil> ceph mon tell '*' injectargs '--mon_debug_dump_transactions 0'
[5:12] <dmick> it looks like it'll take a restart as well
[5:12] <dmick> sorry
[5:13] <dmick> you should be able to restart one at a time and be good tho
[5:13] * todin (tuxadero@kudu.in-berlin.de) has joined #ceph
[5:13] <dmick> since you're gonna do it, you might want to change your .conf
[5:20] <matt_> mikedawson, have you noticed that your store no longer grows with the new mon transaction dump option?
[5:20] <nigwil> is there a way to ask a mon to dump its settings?
[5:21] <nigwil> to confirm the flag is off
[5:21] <dmick> ceph --admin-daemon <path-to-admin-socket> config show
[5:21] <dmick> admin-socket is in /var/lib/ceph, suffixed with asok, by default
[5:22] <mikedawson> matt_: mine are small now... ~300MB each. I felt like I was just lucky
[5:22] <mikedawson> matt_: have you seen them grow with tdump off and stay small with it on?
[5:23] <mikedawson> nigwil: something like ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show
[5:24] <dmick> I pushed a change to the cuttlefish branch, so at least there'll be packages available. Sage will have to make the decision if/when to cut a .2
[5:24] <mikedawson> ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show | grep mon_debug_dump
[5:24] <nigwil> mikedawson: thanks that worked
[5:25] <nigwil> ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show | fgrep mon_debug_dump_transactions
[5:25] <nigwil> save people typing...
[5:26] <nigwil> ok tdump is no longer growing, it was going to bite me since I am copying a million files to my cluster at the moment
[5:26] <dmick> mikedawson: did you send mail?
[5:26] <mikedawson> dmick: a few more seconds...
[5:26] <dmick> if not, yet, include the fact that the cuttlefish builds are happening
[5:28] <mikedawson> dmick: damn. just sent it.
[5:28] <dmick> k, np, I'll follow up
[5:28] <mikedawson> dmick to the rescue (once again!)
[5:30] <mikedawson> Thanks dmick ! Is your job description to cover the later hours? I appreciate you being available whenever I'm working late on EDT
[5:30] <dmick> heh. not in my description, but I like the alone time for focusing on things
[5:31] <mikedawson> right until I derail you with irc :-)
[5:31] <nigwil> is it possible to be along on IRC :-)
[5:31] <nigwil> alone
[5:32] <dmick> well, you know. during the day it's IRC + everything else
[5:33] * nhm_ lurks!
[5:34] <dmick> AAAAAH IT'S nhm_! Lock the doors!
[5:34] <nhm_> I just wanted to make sure you knew I was watching. Now it's time for bed. ;)
[5:40] <dmick> voyeur.
[5:46] <matt_> mikedawson, mine won't grow with the transaction dump on. Solid 800Mb the entire time but as soon as I turned it off they grew again
[5:47] <matt_> mikedawson, I let the dev's know but they seemed equally confused
[5:48] <mikedawson> matt_: I'll watch mine closely, so far it's too soon to tell, but they look like they aren't growing
[5:52] <saras> you guys are have fun tonight
[5:52] <sage> <facepalm>
[5:53] <dmick> hey there he is. heh.
[5:53] <dmick> um, since you're here
[5:53] <dmick> how do I do global_init() from a Python program?
[5:53] <sage> uhm... what do you need that for?
[5:53] <dmick> things like --keyring
[5:53] <sage> librados doesn't have any global state
[5:54] <sage> but you can pass pass random arguments in for parsing
[5:54] <sage> for the given cct context
[5:54] * dmick ponders where that might be in the py objs
[5:54] <sage> int rados_conf_parse_argv(rados_t cluster, int argc, const char **argv);
[5:54] <sage> if you like
[5:54] <sage> probably not exposed by the python bindings
[5:54] <dmick> no I mean the cct
[5:55] <sage> rados_config_t rados_cct(rados_t cluster);
[5:55] <dmick> right
[5:55] <sage> probably not exposed tho.. it'll just have the rados_t handle
[5:55] <dmick> yeah. I think it's gonna need to be
[5:56] <saras> wow sage you really c++ guy you don't even for the ; in irc
[5:56] <dmick> or...hm. the __init__ takes a conf. maybe that's my hook.
[5:57] <sage> :)
[5:57] <dmick> yeah, I bet that works. whew!
[6:04] * DarkAceZ (~BillyMays@50.107.54.92) has joined #ceph
[6:05] <dmick> sage: will the injectargs work? It seemed like that param was only read in the constructor (but maybe the object lifetime is shorter than I think?)
[6:08] <sage> ugh, yeah you're right.
[6:15] <saras> by the way do most school teach visual s&^*)
[6:16] * lx0 (~aoliva@lxo.user.oftc.net) has joined #ceph
[6:16] <dmick> saras: what?
[6:17] <saras> the ms visual stuido ms poop for c++ really
[6:17] <dmick> oh. I hope not. I hope most schools focus on the language and not the env
[6:18] <saras> me too but that does not seem to be the case so far
[6:20] <saras> 2. Choose “Win32 Console Application.” what linux lets me do that
[6:21] * lxo (~aoliva@lxo.user.oftc.net) Quit (Ping timeout: 480 seconds)
[6:25] * davidzlap1 (~Adium@ip68-96-75-123.oc.oc.cox.net) Quit (Quit: Leaving.)
[6:33] * sjustlaptop (~sam@mf35636d0.tmodns.net) has joined #ceph
[6:45] * sjustlaptop (~sam@mf35636d0.tmodns.net) Quit (Ping timeout: 480 seconds)
[7:17] <saras> ok how many prints does sage need I see 3 behind in floss video
[7:18] <saras> printers
[7:18] <sage> one of them sort of works
[7:18] <sage> i hate printers
[7:18] <dmick> printers deserve your hate
[7:18] <dmick> I thought I was out of the hating biz with color lasers, but now it's just damaged-drum hell
[7:20] <saras> some how that does not suprise me
[7:20] * ScOut3R (~ScOut3R@BC065755.dsl.pool.telekom.hu) has joined #ceph
[7:22] <saras> the last carrier had old Xerox guy US Navy 1000 of tech on door but we need a old fart Xerox guy really
[7:26] <saras> anyone inktank has in miltary time
[7:26] <dmick> can't quite parse that saras...what about military time?
[7:28] <saras> did anyone at inktank spend time the in the miliary
[7:28] <dmick> ah. I was thinking "military time" like "2000 hours" :)
[7:28] <dmick> no one that I'm aware of...
[7:28] <dmick> well, Yehuda
[7:30] <saras> oh
[7:31] * Kioob (~kioob@2a01:e35:2432:58a0:21e:8cff:fe07:45b6) Quit (Quit: Leaving.)
[7:31] <dmick> sage: woot, actually limping along finally
[7:31] * Kioob (~kioob@luuna.daevel.fr) has joined #ceph
[7:31] <sage> yay
[7:31] <dmick> pg dump just worked
[7:31] <sage> sweet
[7:31] <dmick> still need --watch* and --admin-daemon, but ... sooon
[7:31] <sage> yeah
[7:31] <sage> progress!
[7:33] <saras> by I would need to use cephFS to not have single point of fault
[7:33] * ScOut3R (~ScOut3R@BC065755.dsl.pool.telekom.hu) Quit (Ping timeout: 480 seconds)
[7:39] <nigwil> is there any community consensus for preferred cluster tools? pssh or pdsh or ? it would seem to be useful to have something that can understand ceph.conf (ceph ls) that can apply some operation to all OSDs or all Ceph nodes etc
[7:40] <dmick> it would be handy to have something to "go futz with all my hosts", but they may not be in ceph.conf
[7:41] <nigwil> that too. I would like to see if SMART is useful for watching all the OSDs, at least to see what state all the drives are in
[7:44] <dmick> nigwil: what I mean is, coming up with the list of hosts is more complex than just parsing the conf; it may be that ceph can't help a whole lot there. I mean, you could maybe do some queries to find out the hosts, but it may be as simple to just keep your own list
[7:44] <dmick> sage: hm, hanging in Cond::wait; maybe I'm doing the waiting wrong
[7:44] <nigwil> dmick: good point
[7:44] <sage> mon command?
[7:45] <sage> debug ms = 1 and debug monc = 20
[7:45] <dmick> actually, yes, although this ought to have been pg_command, but...
[7:45] <dmick> but it's in my librados shim
[7:45] <dmick> but, yeah, monc, maybe
[7:46] <sage> what command is it?
[7:46] <dmick> well, I sent pg 0.0 query, which may not even be a command, so it should/might have been some kind of parsing error, but, the wait never terminated
[7:49] <dmick> lemme watch the mon and see where it's going
[7:51] <sage> are teh osds up/healthy?
[7:51] <dmick> yeah
[7:51] <sage> in that case debug objecter = 20 too
[7:56] <nigwil> after a quick survey I'm going for pdsh(https://code.google.com/p/pdsh/wiki/UsingPDSH) out of ClusterSSH, bashreduce, func, Capistrano etc
[7:56] <sage> i'm a fan of pdsh
[7:57] <dmick> I use dsh
[7:57] <dmick> nhm likes pdsh too
[7:58] <dmick> ok, so I'm not handling the pg correctly, sending it to a mon command, so it ends up in PGMonitor and tries to return "unknown command"
[8:00] <dmick> which, probably wrongly, is returning false, so it's continuing through PaxosService::dispatch
[8:02] <sage> bah
[8:03] <dmick> looks like I'm the one that broke that
[8:04] <dmick> no, no, it just didn't set a status message before
[8:04] <dmick> hm
[8:05] <dmick> well let me try to make it pass a valid command, but invalid handling isn't right as is somehow
[8:11] * Cube (~Cube@cpe-76-95-217-129.socal.res.rr.com) has joined #ceph
[8:18] * loicd (~loic@magenta.dachary.org) Quit (Quit: Leaving.)
[8:18] * loicd (~loic@magenta.dachary.org) has joined #ceph
[8:19] <dmick> oh. duh. right.
[8:19] <dmick> I had been using the original CLI for these commands
[8:19] <dmick> so I've never redone OSD::do_command to use the new cmdmap. oopsie.
[8:32] <saras> people use google code
[8:36] * tnt (~tnt@91.177.214.32) has joined #ceph
[8:36] <Kioob> hi
[8:36] <Kioob> since yesterday I still have a lot of "45 slow requests, 6 included below; oldest blocked for > 1021.389943 secs"
[8:37] <Kioob> is there a way to find the source of that problem ?
[8:40] <Kioob> is there a way to see why it's blocked ?
[8:44] <tnt> the next line of the log should tell you what it's waiting on
[8:52] * rustam (~rustam@94.15.91.30) has joined #ceph
[8:55] * rustam (~rustam@94.15.91.30) Quit (Remote host closed the connection)
[9:01] <Kioob> slow request 240.501248 seconds old, received at 2013-05-11 07:38:26.343763: osd_op(client.11634701.1:40563 rb.0.2d76b.238e1f29.000000000026 [read 2883584~16384] 4.64c2505c RETRY=-1 e78796) currently reached pg
[9:02] <Kioob> "currently reached pg" = waiting for disk ?
[9:04] <Kioob> ah !
[9:04] <Kioob> I suppose I have a winner "currently waiting for pg to exist locally"
[9:04] <Kioob> so, osd are frozen, waiting for recovery
[9:05] <Kioob> ok
[9:05] * jamespage (~jamespage@culvain.gromper.net) Quit (Quit: Coyote finally caught me)
[9:07] <Kioob> (thanks)
[9:12] * dmick (~dmick@2607:f298:a:607:a5bb:a325:519b:6e2c) Quit (Quit: Leaving.)
[9:17] * chutz (~chutz@rygel.linuxfreak.ca) Quit (Quit: Leaving)
[9:21] <Muhlemmer> g'day
[9:23] <Muhlemmer> in the ceph.com docs there are some minumum hardware recommendations
[9:23] <Muhlemmer> http://ceph.com/docs/master/install/hardware-recommendations/#minimum-hardware-recommendations
[9:24] <Muhlemmer> it is mentioned this is for small production clusters and dev. clusters
[9:24] <Muhlemmer> how does this related to large production clusters?
[9:25] <nigwil> I guess it might be worth looking at some reference designs, Inktank+Dell have an example there
[9:25] <Muhlemmer> nigwil: you mean at the bottom of the page?
[9:26] <nigwil> http://www.inktank.com/dell/
[9:27] * BillK (~BillK@124-169-231-135.dyn.iinet.net.au) has joined #ceph
[9:27] <nigwil> somewhere there is a link to a C8000 based design
[9:28] <nigwil> when you say "large", do you have something in mind?
[9:31] <Muhlemmer> 9x36 4TB disks
[9:32] <Muhlemmer> and I am worried about the RAM req. for monitors and mds
[9:32] <nigwil> do you have dedicated MON servers?
[9:33] <Muhlemmer> that is the intention
[9:33] <Muhlemmer> but I am trying to figure out what the specs for these mon servers are (and mds)
[9:33] <Muhlemmer> and exploring the possibilty to combine mds and mon
[9:34] <nigwil> my tiny home cluster shows MON using about 1/3 the memory of the OSDs
[9:34] <Muhlemmer> as, the mon just needs RAM, not much cpu. But you need much CPU (a lot of cores) if you want to adress huge amounts of ram
[9:34] <nigwil> fair question, I don't know
[9:35] * eschnou (~eschnou@175.93-201-80.adsl-dyn.isp.belgacom.be) has joined #ceph
[9:35] <Muhlemmer> but having such an amount of cpu power, I might as well run de mds on the same server, since they need RAM and CPU power
[9:35] <BillK> anyone seen "0 log [WRN] : reached concerning levels of available space on data store (25% free)", but i have only used 173G of 5.6TB
[9:36] <BillK> 0.61.1, and its just crashed :(
[9:36] <nigwil> Muhlemmer: I suggest describing your planned config and posting to the Ceph user newsgroup
[9:36] <nigwil> BillK: did you see the tdump problem with 0.61.1?
[9:37] <BillK> nigwil: no, reference?
[9:37] <nigwil> see the urgent post to the newsgroup
[9:37] <BillK> nigwil: ok
[9:37] <nigwil> basically that version has debug transactions switched on by mistake for MONs - will consume a lot of diskspace
[9:38] <nigwil> maybe not your problem though
[9:38] <BillK> nigwil: it happened while I was pushing a 28G qemu image into the cluster
[9:39] <nigwil> ick, that is big. Don't think I've tried anything that large yet
[9:41] <BillK> nigwil: looked at main ceph site no notice on main page? - where is this newsgroup? - 0.60 took a 16G image no problems so I didnt expect this
[9:57] <nigwil> http://dir.gmane.org/gmane.comp.file-systems.ceph.user
[9:57] <nigwil> or you can use your fave NNTP client and provider (google groups etc) to read/post
[9:59] <nigwil> http://permalink.gmane.org/gmane.comp.file-systems.ceph.user/1295
[9:59] <nigwil> note the inject option won't work, you have to modify your ceph.conf and restart the MONs
[10:00] <BillK> nigwil: tkx, went back to 0.61 , firefox reads gmane just fine, looking at it now, tkx muchly!
[10:09] * eschnou (~eschnou@175.93-201-80.adsl-dyn.isp.belgacom.be) Quit (Ping timeout: 480 seconds)
[10:10] * jjgalvez (~jjgalvez@cpe-76-175-30-67.socal.res.rr.com) Quit (Quit: Leaving.)
[10:10] * jjgalvez (~jjgalvez@cpe-76-175-30-67.socal.res.rr.com) has joined #ceph
[10:18] * jjgalvez (~jjgalvez@cpe-76-175-30-67.socal.res.rr.com) Quit (Ping timeout: 480 seconds)
[10:20] * rustam (~rustam@94.15.91.30) has joined #ceph
[10:32] * lightspeed (~lightspee@81.187.0.153) Quit (Ping timeout: 480 seconds)
[10:37] * rustam (~rustam@94.15.91.30) Quit (Remote host closed the connection)
[11:02] * Cube (~Cube@cpe-76-95-217-129.socal.res.rr.com) Quit (Quit: Leaving.)
[11:08] * tserong (~tserong@124-171-115-108.dyn.iinet.net.au) Quit (Quit: Leaving)
[11:11] * BManojlovic (~steki@fo-d-130.180.254.37.targo.rs) has joined #ceph
[11:21] * rustam (~rustam@94.15.91.30) has joined #ceph
[11:23] * rustam (~rustam@94.15.91.30) Quit (Remote host closed the connection)
[11:24] * esammy (~esamuels@host-2-103-103-135.as13285.net) has joined #ceph
[11:32] * Cube (~Cube@cpe-76-95-217-129.socal.res.rr.com) has joined #ceph
[11:44] * Cube (~Cube@cpe-76-95-217-129.socal.res.rr.com) Quit (Ping timeout: 480 seconds)
[11:51] * tserong (~tserong@124-171-115-108.dyn.iinet.net.au) has joined #ceph
[12:04] * BillK (~BillK@124-169-231-135.dyn.iinet.net.au) Quit (Quit: Leaving)
[12:04] * BillK (~BillK@124-169-231-135.dyn.iinet.net.au) has joined #ceph
[12:10] * lx0 (~aoliva@lxo.user.oftc.net) Quit (Remote host closed the connection)
[12:10] * lx0 (~aoliva@lxo.user.oftc.net) has joined #ceph
[12:15] * BManojlovic (~steki@fo-d-130.180.254.37.targo.rs) Quit (Quit: Ja odoh a vi sta 'ocete...)
[12:22] * frank9999 (~frank@kantoor.transip.nl) has joined #ceph
[12:24] * rustam (~rustam@94.15.91.30) has joined #ceph
[12:29] * eegiks (~quassel@2a01:e35:8a2c:b230:998e:383e:ebba:8709) Quit (Ping timeout: 480 seconds)
[12:31] * eegiks (~quassel@2a01:e35:8a2c:b230:98d5:8632:b533:6675) has joined #ceph
[12:31] <Kioob> So, is there a way to fix that kind of error :
[12:31] <Kioob> pg 8.71d is stuck inactive since forever, current state incomplete, last acting [24,19]
[12:32] <Kioob> there's probably some data loss, but how to fix that ?
[12:33] <mrjack> ceph pg repair 8.71d?
[12:39] <Kioob> I was thinking that repair was for "inconsistent" errors
[12:40] <tnt> what does a ceph pg query 8.71d return ?
[12:42] <Kioob> http://pastebin.com/YZvt219A
[12:43] <Kioob> � � � � � "down_osds_we_would_probe": [], � � � � � "peering_blocked_by": []},
[12:43] <Kioob> this entries are empty
[12:50] * rustam (~rustam@94.15.91.30) Quit (Remote host closed the connection)
[12:57] * tnt (~tnt@91.177.214.32) Quit (Ping timeout: 480 seconds)
[12:57] * mikedawson (~chatzilla@c-98-220-189-67.hsd1.in.comcast.net) Quit (Ping timeout: 480 seconds)
[13:23] * BManojlovic (~steki@fo-d-130.180.254.37.targo.rs) has joined #ceph
[13:26] * eschnou (~eschnou@175.93-201-80.adsl-dyn.isp.belgacom.be) has joined #ceph
[13:27] * lightspeed (~lightspee@81.187.0.153) has joined #ceph
[13:30] * rustam (~rustam@94.15.91.30) has joined #ceph
[13:36] * Cube (~Cube@cpe-76-95-217-129.socal.res.rr.com) has joined #ceph
[13:45] * Cube (~Cube@cpe-76-95-217-129.socal.res.rr.com) Quit (Ping timeout: 480 seconds)
[13:46] <mrjack> 2013-05-11 13:43:59.847226 osd.6 [WRN] map e3768 wrongly marked me down
[13:46] <mrjack> 2013-05-11 13:44:39.113609 mon.0 [INF] pgmap v15878179: 768 pgs: 699 active+clean, 51 active+recovery_wait, 18 active+recovering; 1543 GB data, 3097 GB used, 3076 GB / 6359 GB avail; 490KB/s wr, 96op/s; -13/813607 degraded (-0.002%); recovering 10 o/s, 37800KB/s
[13:46] <mrjack> -0.002% degraded?!? ;)
[13:53] <Kioob> nice :)
[13:55] * eschnou (~eschnou@175.93-201-80.adsl-dyn.isp.belgacom.be) Quit (Ping timeout: 480 seconds)
[14:01] <saras> is their any thing on github like the blueprints on lanuchpad
[14:12] * BManojlovic (~steki@fo-d-130.180.254.37.targo.rs) Quit (Ping timeout: 480 seconds)
[14:24] <Muhlemmer> is it possible to use btrfs compression in RADOS object store?
[14:25] <Muhlemmer> of more precisely: can I pass custom mount parameters when initializing an ODS?
[14:49] * mikedawson (~chatzilla@c-98-220-189-67.hsd1.in.comcast.net) has joined #ceph
[14:54] <saras> https://blueprints.launchpad.net/ceph-pi/+spec/porting and now not sure who have bigger issue with launchpad or github they both are beingg a pain
[14:58] <mrjack_> Kioob: it seems rbd rm <image> produces lots of slow requests for my ceph installation
[15:03] <saras> sage in his 30's right
[15:04] * loicd (~loic@magenta.dachary.org) Quit (Quit: Leaving.)
[15:04] * loicd (~loic@magenta.dachary.org) has joined #ceph
[15:15] * eschnou (~eschnou@175.93-201-80.adsl-dyn.isp.belgacom.be) has joined #ceph
[15:17] * yehuda__ (~yehuda@2602:306:330b:1410:18e9:d53a:acd8:6c3e) Quit (Ping timeout: 480 seconds)
[15:20] * yehuda__ (~yehuda@2602:306:330b:1410:18e9:d53a:acd8:6c3e) has joined #ceph
[15:29] * eschnou (~eschnou@175.93-201-80.adsl-dyn.isp.belgacom.be) Quit (Ping timeout: 480 seconds)
[15:30] * mikedawson (~chatzilla@c-98-220-189-67.hsd1.in.comcast.net) Quit (Ping timeout: 480 seconds)
[15:43] * diegows (~diegows@190.190.2.126) has joined #ceph
[15:47] * rustam (~rustam@94.15.91.30) Quit (Remote host closed the connection)
[15:48] * Muhlemmer (~kvirc@cable-88-137.zeelandnet.nl) Quit (Quit: KVIrc 4.3.1 Aria http://www.kvirc.net/)
[15:51] * rustam (~rustam@94.15.91.30) has joined #ceph
[15:52] <Kioob> from the doc : "Incomplete : Ceph detects that a placement group is missing a necessary period of history from its log. If you see this state, report a bug, and try to start any failed OSDs that may contain the needed information."
[15:52] <Kioob> should I really report that ?
[15:52] * Muhlemmer (~kvirc@cable-88-137.zeelandnet.nl) has joined #ceph
[15:53] * rustam (~rustam@94.15.91.30) Quit (Remote host closed the connection)
[15:58] * diegows (~diegows@190.190.2.126) Quit (Ping timeout: 480 seconds)
[16:03] * eschnou (~eschnou@175.93-201-80.adsl-dyn.isp.belgacom.be) has joined #ceph
[16:10] * eschenal (~eschnou@175.93-201-80.adsl-dyn.isp.belgacom.be) has joined #ceph
[16:11] * rustam (~rustam@94.15.91.30) has joined #ceph
[16:13] * rustam (~rustam@94.15.91.30) Quit (Remote host closed the connection)
[16:13] * eschnou (~eschnou@175.93-201-80.adsl-dyn.isp.belgacom.be) Quit (Ping timeout: 480 seconds)
[16:29] * tnt (~tnt@91.178-201-80.adsl-dyn.isp.belgacom.be) has joined #ceph
[16:35] * BillK (~BillK@124-169-231-135.dyn.iinet.net.au) Quit (Read error: Connection reset by peer)
[16:43] * eschenal (~eschnou@175.93-201-80.adsl-dyn.isp.belgacom.be) Quit (Ping timeout: 480 seconds)
[16:45] * BillK (~BillK@124-169-231-135.dyn.iinet.net.au) has joined #ceph
[16:51] * wschulze (~wschulze@cpe-69-203-80-81.nyc.res.rr.com) has joined #ceph
[17:01] * BManojlovic (~steki@fo-d-130.180.254.37.targo.rs) has joined #ceph
[17:07] * rustam (~rustam@94.15.91.30) has joined #ceph
[17:15] * BManojlovic (~steki@fo-d-130.180.254.37.targo.rs) Quit (Remote host closed the connection)
[17:15] * BManojlovic (~steki@fo-d-130.180.254.37.targo.rs) has joined #ceph
[17:16] * sjustlaptop (~sam@mf35636d0.tmodns.net) has joined #ceph
[17:24] * loicd (~loic@magenta.dachary.org) Quit (Quit: Leaving.)
[17:24] * loicd (~loic@magenta.dachary.org) has joined #ceph
[17:29] * rustam (~rustam@94.15.91.30) Quit (Remote host closed the connection)
[17:39] * leseb (~Adium@bea13-1-82-228-104-16.fbx.proxad.net) has joined #ceph
[17:53] * sjustlaptop (~sam@mf35636d0.tmodns.net) Quit (Ping timeout: 480 seconds)
[18:06] * loicd (~loic@magenta.dachary.org) Quit (Quit: Leaving.)
[18:06] * loicd (~loic@magenta.dachary.org) has joined #ceph
[18:08] * BillK (~BillK@124-169-231-135.dyn.iinet.net.au) Quit (Ping timeout: 480 seconds)
[18:30] * rustam (~rustam@94.15.91.30) has joined #ceph
[18:30] * mikedawson (~chatzilla@c-98-220-189-67.hsd1.in.comcast.net) has joined #ceph
[18:35] * rustam (~rustam@94.15.91.30) Quit (Remote host closed the connection)
[18:43] * sjustlaptop (~sam@mf35636d0.tmodns.net) has joined #ceph
[19:00] * wido__ (~wido@2a00:f10:104:206:9afd:45af:ae52:80) has joined #ceph
[19:01] * scheuk_ (~scheuk@204.246.67.78) has joined #ceph
[19:02] * eschenal (~eschnou@175.93-201-80.adsl-dyn.isp.belgacom.be) has joined #ceph
[19:02] * dxd828 (~dxd828@195.191.107.205) Quit (resistance.oftc.net oxygen.oftc.net)
[19:02] * scheuk (~scheuk@204.246.67.78) Quit (resistance.oftc.net oxygen.oftc.net)
[19:02] * Gugge-47527 (gugge@kriminel.dk) Quit (resistance.oftc.net oxygen.oftc.net)
[19:02] * Meths (rift@2.25.193.124) Quit (resistance.oftc.net oxygen.oftc.net)
[19:02] * NaioN (stefan@andor.naion.nl) Quit (resistance.oftc.net oxygen.oftc.net)
[19:02] * Tribaal (uid3081@hillingdon.irccloud.com) Quit (resistance.oftc.net oxygen.oftc.net)
[19:02] * wido (~wido@rockbox.widodh.nl) Quit (resistance.oftc.net oxygen.oftc.net)
[19:02] * SpamapS (~clint@xencbyrum2.srihosting.com) Quit (resistance.oftc.net oxygen.oftc.net)
[19:02] * MK_FG (~MK_FG@00018720.user.oftc.net) Quit (resistance.oftc.net oxygen.oftc.net)
[19:02] * raso (~raso@deb-multimedia.org) Quit (resistance.oftc.net oxygen.oftc.net)
[19:02] * rturk-away (~rturk@ds2390.dreamservers.com) Quit (resistance.oftc.net oxygen.oftc.net)
[19:02] * Meths (rift@2.25.193.124) has joined #ceph
[19:02] * NaioN (stefan@andor.naion.nl) has joined #ceph
[19:02] * SpamapS (~clint@xencbyrum2.srihosting.com) has joined #ceph
[19:03] * sjustlaptop (~sam@mf35636d0.tmodns.net) Quit (Ping timeout: 480 seconds)
[19:03] * Gugge-47527 (gugge@kriminel.dk) has joined #ceph
[19:05] * rturk-away (~rturk@ds2390.dreamservers.com) has joined #ceph
[19:05] * MK_FG (~MK_FG@00018720.user.oftc.net) has joined #ceph
[19:14] * raso (~raso@deb-multimedia.org) has joined #ceph
[19:14] * dxd828 (~dxd828@195.191.107.205) has joined #ceph
[19:15] * loicd (~loic@magenta.dachary.org) Quit (Quit: Leaving.)
[19:15] * loicd (~loic@magenta.dachary.org) has joined #ceph
[19:15] * loicd (~loic@magenta.dachary.org) Quit ()
[19:16] * SvenPHX (~scarter@wsip-174-79-34-244.ph.ph.cox.net) has joined #ceph
[19:26] * kyle_ (~kyle@216.183.64.10) Quit (Read error: Connection reset by peer)
[19:26] * kyle_ (~kyle@216.183.64.10) has joined #ceph
[19:47] <mrjack> for some reason, rbd rm <image> produces lots of slow requests
[19:47] <mrjack> with 0.56.6
[19:57] * stxShadow (~Jens@ip-88-152-161-249.unitymediagroup.de) has joined #ceph
[19:57] * eschenal (~eschnou@175.93-201-80.adsl-dyn.isp.belgacom.be) Quit (Ping timeout: 480 seconds)
[20:07] * hflai_ (~hflai@alumni.cs.nctu.edu.tw) has joined #ceph
[20:09] * pioto_ (~pioto@pool-96-235-30-25.pitbpa.fios.verizon.net) has joined #ceph
[20:09] * hflai (~hflai@alumni.cs.nctu.edu.tw) Quit (Read error: Connection reset by peer)
[20:09] * iggy2 (~iggy@theiggy.com) has joined #ceph
[20:09] * Anticime1 (anticimex@netforce.csbnet.se) has joined #ceph
[20:10] * Anticimex (anticimex@netforce.csbnet.se) Quit (Read error: Connection reset by peer)
[20:10] * ivan` (~ivan`@000130ca.user.oftc.net) Quit (Ping timeout: 480 seconds)
[20:10] * n1md4_ (~nimda@anion.cinosure.com) has joined #ceph
[20:11] * iggy (~iggy@theiggy.com) Quit (Read error: Connection reset by peer)
[20:11] * ggreg_ (~ggreg@int.0x80.net) has joined #ceph
[20:11] * cclien (~cclien@ec2-50-112-123-234.us-west-2.compute.amazonaws.com) has joined #ceph
[20:11] * brambles_ (lechuck@s0.barwen.ch) has joined #ceph
[20:11] * cephalobot` (~ceph@ds2390.dreamservers.com) has joined #ceph
[20:11] * mnash_ (~chatzilla@66-194-114-178.static.twtelecom.net) has joined #ceph
[20:11] * iggy2 is now known as iggy
[20:12] * KindTwo (KindOne@h240.35.28.71.dynamic.ip.windstream.net) has joined #ceph
[20:13] * themgt (~themgt@24-177-232-33.dhcp.gnvl.sc.charter.com) has joined #ceph
[20:14] * ivan` (~ivan`@000130ca.user.oftc.net) has joined #ceph
[20:14] * juuva_ (~juuva@dsl-hkibrasgw5-58c05e-231.dhcp.inet.fi) has joined #ceph
[20:14] * markl_ (~mark@tpsit.com) has joined #ceph
[20:15] * john_barbee__ (~jbarbee@c-98-226-73-253.hsd1.in.comcast.net) has joined #ceph
[20:15] * houkouonchi (~linux@12.248.40.138) has joined #ceph
[20:17] * john_barbee_ (~jbarbee@c-98-226-73-253.hsd1.in.comcast.net) Quit (synthon.oftc.net larich.oftc.net)
[20:17] * KindOne (KindOne@0001a7db.user.oftc.net) Quit (synthon.oftc.net larich.oftc.net)
[20:17] * topro (~topro@host-62-245-142-50.customer.m-online.net) Quit (synthon.oftc.net larich.oftc.net)
[20:17] * mnash (~chatzilla@66-194-114-178.static.twtelecom.net) Quit (synthon.oftc.net larich.oftc.net)
[20:17] * Fetch (fetch@gimel.cepheid.org) Quit (synthon.oftc.net larich.oftc.net)
[20:17] * ggreg (~ggreg@int.0x80.net) Quit (synthon.oftc.net larich.oftc.net)
[20:17] * n1md4 (~nimda@anion.cinosure.com) Quit (synthon.oftc.net larich.oftc.net)
[20:17] * houkouonchi-work (~linux@12.248.40.138) Quit (synthon.oftc.net larich.oftc.net)
[20:17] * Sargun_ (~sargun@208-106-98-2.static.sonic.net) Quit (synthon.oftc.net larich.oftc.net)
[20:17] * brambles (lechuck@s0.barwen.ch) Quit (synthon.oftc.net larich.oftc.net)
[20:17] * cephalobot (~ceph@ds2390.dreamservers.com) Quit (synthon.oftc.net larich.oftc.net)
[20:17] * phantomcircuit (~phantomci@covertinferno.org) Quit (synthon.oftc.net larich.oftc.net)
[20:17] * cclien_ (~cclien@ec2-50-112-123-234.us-west-2.compute.amazonaws.com) Quit (synthon.oftc.net larich.oftc.net)
[20:17] * juuva (~juuva@dsl-hkibrasgw5-58c05e-231.dhcp.inet.fi) Quit (synthon.oftc.net larich.oftc.net)
[20:17] * pioto (~pioto@pool-96-235-30-25.pitbpa.fios.verizon.net) Quit (synthon.oftc.net larich.oftc.net)
[20:17] * benner (~benner@193.200.124.63) Quit (synthon.oftc.net larich.oftc.net)
[20:17] * markl (~mark@tpsit.com) Quit (synthon.oftc.net larich.oftc.net)
[20:17] * KindTwo is now known as KindOne
[20:17] * mnash_ is now known as mnash
[20:17] * Fetch (fetch@gimel.cepheid.org) has joined #ceph
[20:17] * benner (~benner@193.200.124.63) has joined #ceph
[20:17] * Sargun (~sargun@208-106-98-2.static.sonic.net) has joined #ceph
[20:17] * phantomcircuit (~phantomci@covertinferno.org) has joined #ceph
[20:25] * Cube (~Cube@cpe-76-95-217-129.socal.res.rr.com) has joined #ceph
[20:28] * wschulze (~wschulze@cpe-69-203-80-81.nyc.res.rr.com) Quit (Quit: Leaving.)
[20:30] * jackhill (jackhill@pilot.trilug.org) has joined #ceph
[20:34] * Cube1 (~Cube@cpe-76-95-217-129.socal.res.rr.com) has joined #ceph
[20:35] * Cube (~Cube@cpe-76-95-217-129.socal.res.rr.com) Quit (Read error: Connection reset by peer)
[20:50] * leseb (~Adium@bea13-1-82-228-104-16.fbx.proxad.net) Quit (Quit: Leaving.)
[20:50] * buck (~buck@c-24-6-91-4.hsd1.ca.comcast.net) has joined #ceph
[20:51] <buck> does the last retweet from the @inktank account look dodgy to anyone?
[20:52] <jksM> it does look a bit odd yes
[20:52] <jksM> links to some kind of japanese nwes site
[20:52] <buck> Yeah, it doesn't seem storage related and the phrasing looks very spam-ish to me
[20:53] <jksM> otoh the site does indeed have news about ceph on it
[20:53] <jksM> I don't read japanese, so I have no clue about the rest of the site ;-)
[20:54] <buck> I'm in the same boat. Maybe it is legit.
[20:54] * Tribaal (uid3081@id-3081.hillingdon.irccloud.com) has joined #ceph
[21:13] * aliguori (~anthony@cpe-70-112-157-87.austin.res.rr.com) Quit (Remote host closed the connection)
[21:16] * mega_au (~chatzilla@84.244.21.218) has joined #ceph
[21:17] <mega_au> I'm getting heaps of osd.1 [ERR] 2.33 caller_ops.size 3002 > log size 3001 when one of osds is restarted. Can someone please enlighten me what does it mean?
[21:20] * leseb (~Adium@bea13-1-82-228-104-16.fbx.proxad.net) has joined #ceph
[21:21] * lando` (~lando@login.lando.us) has joined #ceph
[21:21] <lando`> hi
[21:23] * fridad (~oftc-webi@p4FC2DE40.dip0.t-ipconnect.de) has joined #ceph
[21:27] * wschulze (~wschulze@cpe-69-203-80-81.nyc.res.rr.com) has joined #ceph
[21:28] * wschulze (~wschulze@cpe-69-203-80-81.nyc.res.rr.com) Quit ()
[21:32] * leseb (~Adium@bea13-1-82-228-104-16.fbx.proxad.net) Quit (Ping timeout: 480 seconds)
[21:39] * eschenal (~eschnou@175.93-201-80.adsl-dyn.isp.belgacom.be) has joined #ceph
[21:59] * fridad (~oftc-webi@p4FC2DE40.dip0.t-ipconnect.de) Quit (Remote host closed the connection)
[22:05] <buck> I installed cuttlefish with ceph-deploy and running 'sudo service ceph -a stop' doesn't stop the service
[22:05] <buck> /etc/init.d/ceph -a stop is likewise ineffective
[22:05] <buck> has anyone else run int othat?
[22:17] * rustam (~rustam@94.15.91.30) has joined #ceph
[22:21] * Cube1 (~Cube@cpe-76-95-217-129.socal.res.rr.com) Quit (Quit: Leaving.)
[22:25] * leseb (~Adium@bea13-1-82-228-104-16.fbx.proxad.net) has joined #ceph
[22:34] * leseb (~Adium@bea13-1-82-228-104-16.fbx.proxad.net) Quit (Ping timeout: 480 seconds)
[22:46] * rustam (~rustam@94.15.91.30) Quit (Remote host closed the connection)
[23:00] * stxShadow (~Jens@ip-88-152-161-249.unitymediagroup.de) Quit (Read error: Connection reset by peer)
[23:09] * loicd (~loic@magenta.dachary.org) has joined #ceph
[23:11] * rustam (~rustam@94.15.91.30) has joined #ceph
[23:14] * yehuda__ (~yehuda@2602:306:330b:1410:18e9:d53a:acd8:6c3e) Quit (Ping timeout: 480 seconds)
[23:16] * yehuda_hm (~yehuda@2602:306:330b:1410:9c43:730e:bbf0:a165) has joined #ceph
[23:26] * leseb (~Adium@bea13-1-82-228-104-16.fbx.proxad.net) has joined #ceph
[23:27] <nigwil> the inktank tweet is referring to this? http://thevarguy.com/big-data-technology-solutions-and-information/inktank-ceph-upgrade-targets-big-data-storage-red-hat-
[23:29] * DarkAceZ (~BillyMays@50.107.54.92) Quit (Ping timeout: 480 seconds)
[23:34] * leseb (~Adium@bea13-1-82-228-104-16.fbx.proxad.net) Quit (Ping timeout: 480 seconds)
[23:39] * Vjarjadian (~IceChat77@90.214.208.5) has joined #ceph
[23:49] * rustam (~rustam@94.15.91.30) Quit (Remote host closed the connection)
[23:49] * loicd (~loic@magenta.dachary.org) Quit (Quit: Leaving.)
[23:49] * loicd (~loic@magenta.dachary.org) has joined #ceph
[23:53] * tnt (~tnt@91.178-201-80.adsl-dyn.isp.belgacom.be) Quit (Ping timeout: 480 seconds)
[23:54] * eschenal (~eschnou@175.93-201-80.adsl-dyn.isp.belgacom.be) Quit (Quit: Leaving)

These logs were automatically created by CephLogBot on irc.oftc.net using the Java IRC LogBot.