#ceph IRC Log

Index

IRC Log for 2016-05-19

Timestamps are in GMT/BST.

[0:03] * daviddcc (~dcasier@84.197.151.77.rev.sfr.net) has joined #ceph
[0:10] * bniver (~bniver@71-9-144-29.static.oxfr.ma.charter.com) Quit (Quit: Leaving)
[0:14] * BlaXpirit_ (~irc@blaxpirit.com) has joined #ceph
[0:16] <singler> can someone share some tips how could I force ceph-fuse to read in larger chunks? It looks like it does ~100k reads. I didn't manage to make it read in bigger chunks (e.g. to read-ahead few objects). Debian jessie, 3.18 kernel, jewel
[0:16] * demonspork (~N3X15@7V7AAEWX3.tor-irc.dnsbl.oftc.net) Quit ()
[0:17] * grauzikas (grauzikas@78-56-222-78.static.zebra.lt) Quit (Ping timeout: 480 seconds)
[0:17] * grauzikas (grauzikas@78-56-222-78.static.zebra.lt) has joined #ceph
[0:17] <gregsfortytwo> singler: where are you measuring those read sizes?
[0:17] * BlaXpirit (~irc@blaxpirit.com) Quit (Ping timeout: 480 seconds)
[0:17] * BlaXpirit_ is now known as BlaXpirit
[0:19] <singler> num_read_kb and num_read counters. (graphs per second). Also clients read performace is quite poor. On same cluster testing 4.5 kernel client - it works faster and I think it does less reads (but I am not sure about this now). So problem seems to be somewhere in fuse
[0:21] <gregsfortytwo> yeah, FUSE has a max size it tends to use
[0:21] <singler> I am able to do large writes into cluster via fuse, but reads are small..
[0:21] * derjohn_mob (~aj@p578b6aa1.dip0.t-ipconnect.de) has joined #ceph
[0:22] <singler> is it possible to increase that size somehow? I would imagine that ceph side of fuse could read larger chunks and if needed feed smaller chunks via fuse to client
[0:22] * Racpatel (~Racpatel@2601:87:3:3601::6f15) Quit (Ping timeout: 480 seconds)
[0:22] <singler> but it looks like it doesn't work like that..
[0:23] <gregsfortytwo> yeah, there's some kind of large-reads option in FUSE
[0:23] <gregsfortytwo> I think we auto-set it on kernels which support it, but maybe not...
[0:24] <gregsfortytwo> hmm, the fuse manpage says large_read isn't necessary, but you can set max_read and max_readahead
[0:24] <gregsfortytwo> but they're apparently limited to 32 pages?
[0:25] <singler> I tried setting them, it didn't help me. also after setting max_readhead does not appear in "mount" output
[0:25] <gregsfortytwo> oh, it was big_writes that I was thinking of, and it looks like we set that and you're seein git
[0:25] <gregsfortytwo> yeah, I think we may just be stuck, although the internal Client should be doing larger readahead ops to the cluster and satisfying those small reads out of its cache
[0:25] * mnathani2 (~mnathani_@192-0-149-228.cpe.teksavvy.com) Quit ()
[0:30] <singler> "it's cache", like in "client_cache_size"?
[0:30] * singler didn't try increasing it
[0:30] <singler> it defaults to 16384
[0:30] * fsimonce (~simon@host128-29-dynamic.250-95-r.retail.telecomitalia.it) Quit (Quit: Coyote finally caught me)
[0:31] * rendar (~I@host84-39-dynamic.60-82-r.retail.telecomitalia.it) Quit (Quit: std::lower_bound + std::less_equal *works* with a vector without duplicates!)
[0:32] * vanham (~vanham@12.199.84.146) has joined #ceph
[0:34] * linuxkidd_ (~linuxkidd@166.170.46.255) Quit (Ping timeout: 480 seconds)
[0:36] <singler> that didn't help, I am still seeing ~128KB per read
[0:36] <gregsfortytwo> the userspace cephfs client that ceph-fuse is built around has a small internal cache
[0:36] <gregsfortytwo> so it should be doing much larger readahead to the OSDs
[0:36] <gregsfortytwo> but it still has to feed it back to the kernel through the small 128KB reads
[0:37] <gregsfortytwo> looks like maybe that's the way it is on 32-bit systems
[0:37] <gregsfortytwo> on a 64-bit system you maybe get a bit more?
[0:37] <gregsfortytwo> I don't recall if the page size is the same there or not
[0:38] <singler> maybe readaheads needs to be enabled? As on idle test cluster I see 918 num_read/s and 114MB/s
[0:40] <diq> I found similar things over a WAN using the kernel ceph FS module
[0:41] <diq> I couldn't get the client to make enough read-ahead requests to really fill a transport link
[0:41] <diq> Even with the right tcp buffers/windows, I topped out around 150 MB/sec on a 19ms delay link
[0:41] <diq> 10gig
[0:42] <singler> I have http://pastebin.com/3SYe9cwg settings on ceph-fuse and mount with that command
[0:45] * linuxkidd_ (~linuxkidd@38.sub-70-210-245.myvzw.com) has joined #ceph
[0:46] * qable (~ZombieL@163.172.209.46) has joined #ceph
[0:49] * georgem (~Adium@104-222-119-175.cpe.teksavvy.com) has joined #ceph
[1:00] * georgem (~Adium@104-222-119-175.cpe.teksavvy.com) Quit (Quit: Leaving.)
[1:02] * vata1 (~vata@207.96.182.162) Quit (Quit: Leaving.)
[1:04] <singler> gregsfortytwo: can you point me to some docs about ceph-fuse (high level overview, flow, etc) or maybe you remember which part of code is responsible for caching?
[1:04] <gregsfortytwo> if you want to look at the source, it's the ObjectCacher module in ceph/src/osdc/ObjectCacher.[h|cc]
[1:04] <gregsfortytwo> but that won't help you with this bit
[1:05] <gregsfortytwo> readahead is definitely enabled and working by default
[1:05] * ktims_ (~ktims@zero.gotroot.ca) has left #ceph
[1:05] <gregsfortytwo> if you're not seeing it *at all*, then I think you must be doing direct io or something
[1:06] <gregsfortytwo> all the docs we have are under http://docs.ceph.com/docs/master/cephfs/
[1:07] <singler> I do not think that I enable such thing as direct io, unless it get's enabled automagically due to some conditions..
[1:10] <singler> gregsfortytwo: maybe there is some version which you are sure has readahead working? Maybe jewel has some regression or something..
[1:11] <gregsfortytwo> we've had people testing it and looking for stuff like that and they're reporting success :/
[1:11] <gregsfortytwo> (also Jewel really didn't change any of those pieces)
[1:11] * erhudy (uid89730@id-89730.ealing.irccloud.com) Quit (Quit: Connection closed for inactivity)
[1:11] <gregsfortytwo> how are you testing?
[1:13] <singler> last time I did like this: mount with "mount -t fuse.ceph name=client.cephfs,client_mountpoint=/ -o max_readahead=33554432,max_read=33554432 /mnt/cephfs/", then do "dd if=large_file.dd of=/dev/null bs=4M" and look at graph how many num_read and num_read_kb are done
[1:13] <singler> also I drop caches on OSDs
[1:14] <gregsfortytwo> hmm
[1:15] <gregsfortytwo> can you dump the client config out of its admin socket?
[1:15] <singler> http://pastebin.com/3SYe9cwg has some of it. Let me pastebin all of it
[1:15] * squizzi (~squizzi@107.13.31.195) Quit (Quit: Leaving)
[1:16] * qable (~ZombieL@4MJAAE8RG.tor-irc.dnsbl.oftc.net) Quit ()
[1:16] * KapiteinKoffie (~isaxi@anonymous6.sec.nl) has joined #ceph
[1:17] <singler> http://pastebin.com/j25Qu2fn
[1:19] * stiopa (~stiopa@cpc73832-dals21-2-0-cust453.20-2.cable.virginm.net) Quit (Ping timeout: 480 seconds)
[1:19] <singler> also looking at prod cluster graphs it looks like clients are doing 128K reads there too (I have few hammers and infernalis)
[1:22] <gregsfortytwo> hmm, well, try setting client_readahead_max_bytes to 32MB and client_readahead_min_bytes to a more reasonable value (like the default :p) and see if that does anything for you
[1:22] <gregsfortytwo> some of the comparisons here do look a little weird
[1:32] * linuxkidd_ (~linuxkidd@38.sub-70-210-245.myvzw.com) Quit (Quit: Leaving)
[1:38] <singler> gregsfortytwo: thanks! It works now on test setup as expected. I didn't test all the changes from prod, but it looks like client_readahead_max_bytes helped (as it looks to be only seting to differ from prod)
[1:38] <gregsfortytwo> okay
[1:38] <gregsfortytwo> I think we have a comparison against max that should be against min in the source :(
[1:40] * i_m (~ivan.miro@nat-5-carp.hcn-strela.ru) has joined #ceph
[1:41] * eternaleye (~Alex@66.87.139.127) has joined #ceph
[1:45] * oms101 (~oms101@p20030057EA02AC00C6D987FFFE4339A1.dip0.t-ipconnect.de) Quit (Ping timeout: 480 seconds)
[1:45] * eternaleye_ (~Alex@50.245.141.73) Quit (Ping timeout: 480 seconds)
[1:46] * KapiteinKoffie (~isaxi@4MJAAE8SS.tor-irc.dnsbl.oftc.net) Quit ()
[1:46] * Tenk1 (~Vale@151.100.179.50) has joined #ceph
[1:50] * eternaleye_ (~Alex@66-87-139-208.pools.spcsdns.net) has joined #ceph
[1:52] * sudocat (~dibarra@192.185.1.20) Quit (Ping timeout: 480 seconds)
[1:53] * oms101 (~oms101@p20030057EA029D00C6D987FFFE4339A1.dip0.t-ipconnect.de) has joined #ceph
[1:54] * eternaleye (~Alex@66.87.139.127) Quit (Ping timeout: 480 seconds)
[1:56] <singler> is there a way to change ceph-fuse client config online if socket is not present?
[1:56] * Skaag (~lunix@65.200.54.234) Quit (Quit: Leaving.)
[1:57] * smev (~smev@d23-17-52-141.abhsia.telus.net) has joined #ceph
[1:58] <gregsfortytwo> I don't think so, unless SIGHUP causes it to re-read configs
[1:58] * eternaleye (~Alex@66-87-138-29.pools.spcsdns.net) has joined #ceph
[1:58] <hoonetorg> anybody here running ceph with pacemaker resource agents?
[1:59] * eternaleye_ (~Alex@66-87-139-208.pools.spcsdns.net) Quit (Ping timeout: 480 seconds)
[1:59] <hoonetorg> or with pacemaker and systemd init scripts?
[2:00] <hoonetorg> RA's only compatible with sysv
[2:00] <gregsfortytwo> nope, sighup doesn't do it ????? no way to update client configs if you don't have an admin socket
[2:00] <vanham> hoonetorg, I'm sorry for asking but, why are you doing that?
[2:02] <hoonetorg> vanham: an advantage would be if a ceph process would be so half-death (reacting on tcp-requests, but nothing sane comes back)
[2:03] <hoonetorg> and the pacemaker RA would check that on the let's say every 30 sec monitor command
[2:03] <hoonetorg> then it would try to stop and start the ceph process
[2:03] <hoonetorg> and if that wouldn't work a few times it would fence that ceph host
[2:04] <hoonetorg> and after reboot probably everything is fine again
[2:04] <vanham> I can see that for radosgw, but not for the rest of the system. ceph already does that internally. OSDs and MONs will talk to eachother all the time, sending pings and health checks, MDSs and CephFS clients will do the same
[2:05] <hoonetorg> but systemd/the other hosts wouldn't try to restart ceph processes or fence a faulty node
[2:05] <hoonetorg> you can do that only with a cluster manager afaik
[2:06] <hoonetorg> my question is more if people do use pacemaker to start/stop/monitor ceph?
[2:06] <hoonetorg> because resource agents exist (i think written by madkiss in 2012 or so)
[2:07] * eternaleye (~Alex@66-87-138-29.pools.spcsdns.net) Quit (Ping timeout: 480 seconds)
[2:07] <hoonetorg> but does anybody have a large ceph installation which is managed with pacemaker
[2:07] <hoonetorg> ?
[2:07] * LeaChim (~LeaChim@host86-176-96-249.range86-176.btcentralplus.com) Quit (Ping timeout: 480 seconds)
[2:08] <hoonetorg> or does everybody deploy it's ceph cluster with sysv/systemd init scripts?
[2:10] <vanham> hoonetorg, ceph does very well on health checking and on correctly handling every situation there is
[2:10] * lx0 (~aoliva@lxo.user.oftc.net) Quit (Remote host closed the connection)
[2:10] <vanham> pacemaker would do a re-spawn the process again, at best
[2:11] * lx0 (~aoliva@lxo.user.oftc.net) has joined #ceph
[2:11] <hoonetorg> vanham: i know, i only asked myself what these RA's are for and if anybody uses them.
[2:11] <hoonetorg> :)
[2:11] <hoonetorg> seems not
[2:11] <vanham> :)
[2:12] * eternaleye (~Alex@66-87-139-4.pools.spcsdns.net) has joined #ceph
[2:16] * Tenk1 (~Vale@4MJAAE8T4.tor-irc.dnsbl.oftc.net) Quit ()
[2:16] * BlS (~SurfMaths@06SAACO9G.tor-irc.dnsbl.oftc.net) has joined #ceph
[2:16] * eternaleye (~Alex@66-87-139-4.pools.spcsdns.net) Quit (Remote host closed the connection)
[2:24] * huangjun (~kvirc@113.57.168.154) has joined #ceph
[2:35] * DV (~veillard@2001:41d0:a:f29f::1) has joined #ceph
[2:46] * BlS (~SurfMaths@06SAACO9G.tor-irc.dnsbl.oftc.net) Quit ()
[2:46] * arsenaali (~TehZomB@84.216.51.36) has joined #ceph
[2:55] * penguinRaider (~KiKo@146.185.31.226) Quit (Ping timeout: 480 seconds)
[3:01] * rdias (~rdias@bl7-92-98.dsl.telepac.pt) Quit (Ping timeout: 480 seconds)
[3:03] * rdias (~rdias@2001:8a0:749a:d01:591d:9289:9c4:fbb1) has joined #ceph
[3:06] * penguinRaider (~KiKo@14.139.82.6) has joined #ceph
[3:16] * arsenaali (~TehZomB@06SAACPAL.tor-irc.dnsbl.oftc.net) Quit ()
[3:16] * raindog (~Wizeon@edwardsnowden1.torservers.net) has joined #ceph
[3:19] <vanham> Guys, I'm trying to map a RBD format 2 image on an 4.4 kernel but I'm getting the following error: RBD image feature set mismatch. You can disable features unsupported by the kernel with "rbd feature disable".
[3:20] <rkeene> How can I make ceph not kill itself when doing recovery ? It completely ignores all my prioritizations and telling the OSDs to only backfill 1 PG at a time
[3:20] * atheism (~atheism@182.48.117.114) has joined #ceph
[3:22] <vanham> rkeene, osd recovery max active = 5
[3:22] <vanham> osd max backfills = 5
[3:23] <vanham> put that on your ceph.conf
[3:23] <vanham> with a number as big as you want
[3:25] * EinstCrazy (~EinstCraz@58.247.119.250) has joined #ceph
[3:28] * jermudgeon (~jhaustin@gw1.ttp.biz.whitestone.link) Quit (Quit: jermudgeon)
[3:29] <rkeene> I have that, set to 1
[3:29] * georgem (~Adium@104-222-119-175.cpe.teksavvy.com) has joined #ceph
[3:31] * johnhunter (~hunter@139.129.6.152) has joined #ceph
[3:32] <rkeene> Hmm, seems to just take affect sometimes
[3:38] * darkfader (~floh@88.79.251.60) Quit (Read error: Connection reset by peer)
[3:40] * vanham (~vanham@12.199.84.146) Quit (Ping timeout: 480 seconds)
[3:41] * darkfader (~floh@88.79.251.60) has joined #ceph
[3:44] * huangjun|2 (~kvirc@113.57.168.154) has joined #ceph
[3:45] * huangjun (~kvirc@113.57.168.154) Quit (Read error: Connection reset by peer)
[3:46] * raindog (~Wizeon@4MJAAE8W4.tor-irc.dnsbl.oftc.net) Quit ()
[3:46] * xolotl (~Tralin|Sl@relay1.tor.openinternet.io) has joined #ceph
[3:46] * vanham (~vanham@12.199.84.146) has joined #ceph
[3:48] * zhaochao (~zhaochao@125.39.112.4) has joined #ceph
[3:49] * huangjun|2 (~kvirc@113.57.168.154) Quit (Read error: Connection reset by peer)
[3:52] * eternaleye (~Alex@66.87.139.4) has joined #ceph
[3:53] * Mika_c (~Mika@122.146.93.152) has joined #ceph
[3:54] * Mika_c (~Mika@122.146.93.152) has left #ceph
[3:55] * Mika_c (~Mika@122.146.93.152) has joined #ceph
[3:55] * wes_dillingham (~wes_dilli@209-6-222-74.c3-0.hdp-ubr1.sbo-hdp.ma.cable.rcn.com) has joined #ceph
[3:57] * Mika_c (~Mika@122.146.93.152) Quit (Remote host closed the connection)
[3:57] * Mika_c (~Mika@122.146.93.152) has joined #ceph
[4:00] * EinstCra_ (~EinstCraz@58.247.117.134) has joined #ceph
[4:01] * darkfader (~floh@88.79.251.60) Quit (Read error: Connection reset by peer)
[4:03] * darkfader (~floh@88.79.251.60) has joined #ceph
[4:04] * flisky (~Thunderbi@36.110.40.29) has joined #ceph
[4:04] * eternaleye_ (~Alex@66.87.139.134) has joined #ceph
[4:04] * vicente (~~vicente@125-227-238-55.HINET-IP.hinet.net) has joined #ceph
[4:05] * johnhunter_ (uid164434@id-164434.highgate.irccloud.com) has joined #ceph
[4:06] * johnhunter_ is now known as zhjwpku
[4:06] * EinstCrazy (~EinstCraz@58.247.119.250) Quit (Ping timeout: 480 seconds)
[4:07] * kefu (~kefu@183.193.181.153) has joined #ceph
[4:07] * darkfader (~floh@88.79.251.60) Quit (Read error: Connection reset by peer)
[4:08] * darkfader (~floh@88.79.251.60) has joined #ceph
[4:08] * eternaleye (~Alex@66.87.139.4) Quit (Ping timeout: 480 seconds)
[4:08] * kefu (~kefu@183.193.181.153) Quit (Max SendQ exceeded)
[4:08] * shohn (~shohn@ipservice-092-208-209-170.092.208.pools.vodafone-ip.de) Quit (Read error: Connection reset by peer)
[4:09] * kefu (~kefu@183.193.181.153) has joined #ceph
[4:09] * shohn (~shohn@dslb-178-008-197-199.178.008.pools.vodafone-ip.de) has joined #ceph
[4:11] * Nicola-1_ (~Nicola-19@x55b598f6.dyn.telefonica.de) has joined #ceph
[4:13] * eternaleye (~Alex@66.87.138.187) has joined #ceph
[4:14] * ira (~ira@c-24-34-255-34.hsd1.ma.comcast.net) Quit (Ping timeout: 480 seconds)
[4:14] * kefu_ (~kefu@114.92.122.74) has joined #ceph
[4:16] * xolotl (~Tralin|Sl@06SAACPC6.tor-irc.dnsbl.oftc.net) Quit ()
[4:17] * Nicola-1980 (~Nicola-19@x55b42959.dyn.telefonica.de) Quit (Ping timeout: 480 seconds)
[4:18] * kefu (~kefu@183.193.181.153) Quit (Ping timeout: 480 seconds)
[4:19] * winston-d_ (uid98317@id-98317.richmond.irccloud.com) has joined #ceph
[4:19] * eternaleye_ (~Alex@66.87.139.134) Quit (Ping timeout: 480 seconds)
[4:20] * yanzheng (~zhyan@125.70.22.41) has joined #ceph
[4:21] * flisky (~Thunderbi@36.110.40.29) Quit (Quit: flisky)
[4:22] * wes_dillingham (~wes_dilli@209-6-222-74.c3-0.hdp-ubr1.sbo-hdp.ma.cable.rcn.com) Quit (Quit: wes_dillingham)
[4:23] * eternaleye (~Alex@66.87.138.187) Quit (Ping timeout: 480 seconds)
[4:27] * ReSam (ReSam@0001fe39.user.oftc.net) Quit (Quit: ZNC - http://znc.in)
[4:31] * ReSam (ReSam@catrobat-irc.ist.tu-graz.ac.at) has joined #ceph
[4:33] * ira (~ira@c-24-34-255-34.hsd1.ma.comcast.net) has joined #ceph
[4:36] * valeech (~valeech@pool-108-44-162-111.clppva.fios.verizon.net) has joined #ceph
[4:38] * efirs (~firs@c-50-185-70-125.hsd1.ca.comcast.net) has joined #ceph
[4:39] * johnhunter (~hunter@139.129.6.152) Quit (Quit: Leaving)
[4:41] * eternaleye (~Alex@66.87.138.42) has joined #ceph
[4:46] * Jaska (~W|ldCraze@5.189.179.164) has joined #ceph
[4:46] * xarses (~xarses@64.124.158.100) Quit (Ping timeout: 480 seconds)
[4:47] * eternaleye (~Alex@66.87.138.42) Quit (Read error: Connection reset by peer)
[4:49] * Skaag (~lunix@cpe-172-91-77-84.socal.res.rr.com) has joined #ceph
[4:50] * ira (~ira@c-24-34-255-34.hsd1.ma.comcast.net) Quit (Ping timeout: 480 seconds)
[4:53] * eternaleye (~Alex@66.87.138.42) has joined #ceph
[4:53] * ycheng (~ycheng@122.146.93.152) has joined #ceph
[4:54] * lxo (~aoliva@lxo.user.oftc.net) has joined #ceph
[4:55] * xarses (~xarses@c-73-202-191-48.hsd1.ca.comcast.net) has joined #ceph
[4:56] * vbellur1 (~vijay@122.172.243.182) Quit (Ping timeout: 480 seconds)
[4:56] * lx0 (~aoliva@lxo.user.oftc.net) Quit (Ping timeout: 480 seconds)
[4:57] * ira (~ira@c-24-34-255-34.hsd1.ma.comcast.net) has joined #ceph
[4:57] * ira (~ira@c-24-34-255-34.hsd1.ma.comcast.net) Quit (Remote host closed the connection)
[4:59] * vasu (~vasu@c-73-231-60-138.hsd1.ca.comcast.net) Quit (Quit: Leaving)
[5:05] * Mika__ (~Mika@122.146.93.152) has joined #ceph
[5:05] * eternaleye (~Alex@66.87.138.42) Quit (Read error: Connection reset by peer)
[5:05] * Mika_c (~Mika@122.146.93.152) has left #ceph
[5:05] * Mika__ (~Mika@122.146.93.152) Quit (Read error: Connection reset by peer)
[5:05] * lx0 (~aoliva@lxo.user.oftc.net) has joined #ceph
[5:05] * Mika__ (~Mika@122.146.93.152) has joined #ceph
[5:06] * Mika__ (~Mika@122.146.93.152) Quit ()
[5:06] * Mika_c (~Mika@122.146.93.152) has joined #ceph
[5:06] * Mika__ (~Mika@122.146.93.152) has joined #ceph
[5:06] * Mika__ (~Mika@122.146.93.152) Quit ()
[5:06] * Mika_c (~Mika@122.146.93.152) has left #ceph
[5:08] * yuan (~yzhou67@shzdmzpr01-ext.sh.intel.com) has joined #ceph
[5:08] * Mika_c (~Mika@122.146.93.152) has joined #ceph
[5:09] * MentalRay (~MentalRay@MTRLPQ42-1176054809.sdsl.bell.ca) Quit (Ping timeout: 480 seconds)
[5:09] * eternaleye (~Alex@66.87.138.42) has joined #ceph
[5:10] * eternaleye (~Alex@66.87.138.42) Quit (Read error: Connection reset by peer)
[5:11] * eternaleye (~Alex@66-87-138-42.pools.spcsdns.net) has joined #ceph
[5:11] * lxo (~aoliva@lxo.user.oftc.net) Quit (Ping timeout: 480 seconds)
[5:16] * Jaska (~W|ldCraze@4MJAAE801.tor-irc.dnsbl.oftc.net) Quit ()
[5:16] * OODavo (~Xeon06@89.34.237.11) has joined #ceph
[5:23] * Vacuum_ (~Vacuum@88.130.220.176) has joined #ceph
[5:24] * kefu_ (~kefu@114.92.122.74) Quit (Max SendQ exceeded)
[5:25] * kefu (~kefu@li1072-18.members.linode.com) has joined #ceph
[5:26] * lx0 (~aoliva@lxo.user.oftc.net) Quit (Ping timeout: 480 seconds)
[5:28] <Nats> rkeene, if its not clear those are per-OSD limits
[5:29] * OODavo (~Xeon06@06SAACPGH.tor-irc.dnsbl.oftc.net) Quit (Ping timeout: 480 seconds)
[5:29] * Vacuum__ (~Vacuum@88.130.217.34) Quit (Ping timeout: 480 seconds)
[5:35] * lx0 (~aoliva@lxo.user.oftc.net) has joined #ceph
[5:36] * vbellur (~vijay@121.244.87.118) has joined #ceph
[5:41] * jwandborg (~Eric@tor-exit.gansta93.com) has joined #ceph
[5:42] * georgem (~Adium@104-222-119-175.cpe.teksavvy.com) Quit (Quit: Leaving.)
[5:47] * lx0 (~aoliva@lxo.user.oftc.net) Quit (Ping timeout: 480 seconds)
[5:47] * lx0 (~aoliva@lxo.user.oftc.net) has joined #ceph
[5:49] * penguinRaider (~KiKo@14.139.82.6) Quit (Ping timeout: 480 seconds)
[5:51] * vikhyat (~vumrao@121.244.87.116) has joined #ceph
[5:53] * lxo (~aoliva@lxo.user.oftc.net) has joined #ceph
[5:54] * Skaag (~lunix@cpe-172-91-77-84.socal.res.rr.com) Quit (Quit: Leaving.)
[5:59] * lx0 (~aoliva@lxo.user.oftc.net) Quit (Ping timeout: 480 seconds)
[5:59] * penguinRaider (~KiKo@146.185.31.226) has joined #ceph
[6:02] * overclk (~quassel@117.202.96.197) has joined #ceph
[6:07] * wjw-freebsd (~wjw@smtp.digiware.nl) Quit (Ping timeout: 480 seconds)
[6:11] * jwandborg (~Eric@4MJAAE82S.tor-irc.dnsbl.oftc.net) Quit ()
[6:26] * eternaleye (~Alex@66-87-138-42.pools.spcsdns.net) Quit (Quit: Quit)
[6:26] * eternaleye (~Alex@66.87.138.42) has joined #ceph
[6:27] * prallab (~prallab@216.207.42.137) has joined #ceph
[6:27] * eternaleye (~Alex@66.87.138.42) Quit (Read error: Connection reset by peer)
[6:28] * eternaleye (~Alex@66-87-138-42.pools.spcsdns.net) has joined #ceph
[6:41] * eternaleye_ (~Alex@66.87.138.19) has joined #ceph
[6:42] * jermudgeon (~jhaustin@southend.mdu.whitestone.link) has joined #ceph
[6:46] * mrapple (~Aramande_@nl10x.mullvad.net) has joined #ceph
[6:48] * eternaleye (~Alex@66-87-138-42.pools.spcsdns.net) Quit (Ping timeout: 480 seconds)
[6:50] * prallab (~prallab@216.207.42.137) Quit (Remote host closed the connection)
[6:52] * eternaleye (~Alex@66.87.139.182) has joined #ceph
[6:52] * lx0 (~aoliva@lxo.user.oftc.net) has joined #ceph
[6:54] * lxo (~aoliva@lxo.user.oftc.net) Quit (Ping timeout: 480 seconds)
[6:55] * eternaleye__ (~Alex@66-87-138-48.pools.spcsdns.net) has joined #ceph
[6:57] * eternaleye_ (~Alex@66.87.138.19) Quit (Ping timeout: 480 seconds)
[6:58] * eternaleye_ (~Alex@66.87.138.229) has joined #ceph
[6:59] * prallab (~prallab@216.207.42.137) has joined #ceph
[7:00] * nils_ (~nils_@doomstreet.collins.kg) has joined #ceph
[7:01] * eternaleye (~Alex@66.87.139.182) Quit (Ping timeout: 480 seconds)
[7:02] * lx0 (~aoliva@lxo.user.oftc.net) Quit (Ping timeout: 480 seconds)
[7:03] * eternaleye (~Alex@66.87.139.76) has joined #ceph
[7:04] * swami1 (~swami@49.44.57.243) has joined #ceph
[7:04] * eternaleye__ (~Alex@66-87-138-48.pools.spcsdns.net) Quit (Ping timeout: 480 seconds)
[7:05] * wgao (~wgao@106.120.101.38) Quit (Ping timeout: 480 seconds)
[7:05] * eternaleye__ (~Alex@66.87.139.15) has joined #ceph
[7:07] * Skaag (~lunix@cpe-172-91-77-84.socal.res.rr.com) has joined #ceph
[7:08] * codice (~toodles@75-128-34-237.static.mtpk.ca.charter.com) has joined #ceph
[7:09] * wgao (~wgao@106.120.101.38) has joined #ceph
[7:10] * eternaleye_ (~Alex@66.87.138.229) Quit (Ping timeout: 480 seconds)
[7:11] * eternaleye_ (~Alex@66.87.139.3) has joined #ceph
[7:12] * eternaleye (~Alex@66.87.139.76) Quit (Ping timeout: 480 seconds)
[7:15] * mrapple (~Aramande_@06SAACPJT.tor-irc.dnsbl.oftc.net) Quit ()
[7:16] * Jebula (~Izanagi@46.166.188.206) has joined #ceph
[7:16] * TomasCZ (~TomasCZ@yes.tenlab.net) Quit (Quit: Leaving)
[7:18] * eternaleye__ (~Alex@66.87.139.15) Quit (Ping timeout: 480 seconds)
[7:20] * zaitcev (~zaitcev@c-50-130-189-82.hsd1.nm.comcast.net) Quit (Quit: Bye)
[7:22] * rdas (~rdas@121.244.87.116) has joined #ceph
[7:23] * eternaleye_ (~Alex@66.87.139.3) Quit (Ping timeout: 480 seconds)
[7:29] * kefu (~kefu@li1072-18.members.linode.com) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[7:30] * eternaleye_ (~Alex@66.87.138.61) has joined #ceph
[7:38] * eternaleye_ (~Alex@66.87.138.61) Quit (Remote host closed the connection)
[7:42] * swami1 (~swami@49.44.57.243) Quit (Ping timeout: 480 seconds)
[7:44] * swami1 (~swami@49.32.0.152) has joined #ceph
[7:45] * Jebula (~Izanagi@46.166.188.206) Quit ()
[7:46] * w2k (~Grum@217.12.204.104) has joined #ceph
[7:46] * madkiss (~madkiss@2001:6f8:12c3:f00f:8d20:b987:d518:c6d1) has joined #ceph
[7:46] * vata (~vata@cable-21.246.173-197.electronicbox.net) Quit (Quit: Leaving.)
[7:50] * xarses_ (~xarses@c-73-202-191-48.hsd1.ca.comcast.net) has joined #ceph
[7:51] * xarses_ (~xarses@c-73-202-191-48.hsd1.ca.comcast.net) Quit (Remote host closed the connection)
[7:51] * xarses_ (~xarses@c-73-202-191-48.hsd1.ca.comcast.net) has joined #ceph
[7:55] * xarses (~xarses@c-73-202-191-48.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[8:05] * Be-El (~blinke@nat-router.computational.bio.uni-giessen.de) has joined #ceph
[8:08] * jermudgeon (~jhaustin@southend.mdu.whitestone.link) Quit (Quit: jermudgeon)
[8:09] * kefu (~kefu@114.92.122.74) has joined #ceph
[8:09] * jermudgeon (~jhaustin@southend.mdu.whitestone.link) has joined #ceph
[8:15] * w2k (~Grum@4MJAAE86P.tor-irc.dnsbl.oftc.net) Quit ()
[8:16] * blank (~ulterior@176.10.99.208) has joined #ceph
[8:21] * linjan (~linjan@176.195.246.55) Quit (Ping timeout: 480 seconds)
[8:23] * branto (~branto@nat-pool-brq-t.redhat.com) has joined #ceph
[8:24] * trociny (~mgolub@93.183.239.2) Quit (Ping timeout: 480 seconds)
[8:24] * trociny (~mgolub@93.183.239.2) has joined #ceph
[8:28] * i_m (~ivan.miro@nat-5-carp.hcn-strela.ru) Quit (Ping timeout: 480 seconds)
[8:31] * valeech (~valeech@pool-108-44-162-111.clppva.fios.verizon.net) Quit (Quit: valeech)
[8:32] * sickology (~mio@vpn.bcs.hr) Quit (Read error: Connection reset by peer)
[8:32] * valeech (~valeech@pool-108-44-162-111.clppva.fios.verizon.net) has joined #ceph
[8:33] * valeech (~valeech@pool-108-44-162-111.clppva.fios.verizon.net) Quit ()
[8:37] * darkfader (~floh@88.79.251.60) Quit (Read error: Connection reset by peer)
[8:37] * sickology (~mio@vpn.bcs.hr) has joined #ceph
[8:39] * T1w (~jens@node3.survey-it.dk) has joined #ceph
[8:41] * darkfader (~floh@88.79.251.60) has joined #ceph
[8:44] * blank (~ulterior@7V7AAEXIG.tor-irc.dnsbl.oftc.net) Quit (Ping timeout: 480 seconds)
[8:55] * karnan (~karnan@121.244.87.118) has joined #ceph
[8:56] * prallab (~prallab@216.207.42.137) Quit (Remote host closed the connection)
[8:58] * Miouge (~Miouge@94.136.92.20) has joined #ceph
[9:02] * Miouge (~Miouge@94.136.92.20) Quit ()
[9:03] * dvanders_ (~dvanders@dvanders-pro.cern.ch) Quit (Remote host closed the connection)
[9:04] * dvanders (~dvanders@dvanders-pro.cern.ch) has joined #ceph
[9:05] * fsimonce (~simon@host128-29-dynamic.250-95-r.retail.telecomitalia.it) has joined #ceph
[9:05] * karnan (~karnan@121.244.87.118) Quit (Ping timeout: 480 seconds)
[9:07] * bara (~bara@nat-pool-brq-t.redhat.com) has joined #ceph
[9:09] * shohn1 (~shohn@dslb-178-008-197-199.178.008.pools.vodafone-ip.de) has joined #ceph
[9:12] * evelu (~erwan@37.167.12.22) has joined #ceph
[9:13] * Kurt (~Adium@2001:628:1:5:8893:f257:1cf2:77bd) has joined #ceph
[9:14] * shohn (~shohn@dslb-178-008-197-199.178.008.pools.vodafone-ip.de) Quit (Ping timeout: 480 seconds)
[9:16] * CoZmicShReddeR (~Heliwr@relay1.tor.openinternet.io) has joined #ceph
[9:16] * erwan_taf (~erwan@62.147.161.106) Quit (Ping timeout: 480 seconds)
[9:17] * derjohn_mob (~aj@p578b6aa1.dip0.t-ipconnect.de) Quit (Ping timeout: 480 seconds)
[9:18] * karnan (~karnan@121.244.87.117) has joined #ceph
[9:20] * dugravot6 (~dugravot6@dn-infra-04.lionnois.site.univ-lorraine.fr) has joined #ceph
[9:23] * analbeard (~shw@support.memset.com) has joined #ceph
[9:26] * rraja (~rraja@121.244.87.117) has joined #ceph
[9:28] * i_m (~ivan.miro@deibp9eh1--blueice1n1.emea.ibm.com) has joined #ceph
[9:29] * ledgr (~ledgr@88-222-11-185.meganet.lt) has joined #ceph
[9:32] * epicguy (~epicguy@41.164.8.42) has joined #ceph
[9:33] * jermudgeon (~jhaustin@southend.mdu.whitestone.link) Quit (Quit: jermudgeon)
[9:41] * derjohn_mob (~aj@fw.gkh-setu.de) has joined #ceph
[9:45] * Miouge (~Miouge@94.136.92.20) has joined #ceph
[9:46] * CoZmicShReddeR (~Heliwr@4MJAAE89U.tor-irc.dnsbl.oftc.net) Quit ()
[9:46] * Zeis (~OODavo@7V7AAEXL5.tor-irc.dnsbl.oftc.net) has joined #ceph
[9:47] * jordanP (~jordan@92.103.184.178) has joined #ceph
[9:50] * penguinRaider (~KiKo@146.185.31.226) Quit (Ping timeout: 480 seconds)
[9:53] * rotbeard (~redbeard@185.32.80.238) has joined #ceph
[9:53] * wjw-freebsd (~wjw@smtp.digiware.nl) has joined #ceph
[9:56] * EinstCrazy (~EinstCraz@58.247.119.250) has joined #ceph
[10:02] * efirs (~firs@c-50-185-70-125.hsd1.ca.comcast.net) Quit (Quit: Leaving.)
[10:02] * penguinRaider (~KiKo@14.139.82.6) has joined #ceph
[10:03] * ledgr (~ledgr@88-222-11-185.meganet.lt) Quit (Remote host closed the connection)
[10:03] * EinstCra_ (~EinstCraz@58.247.117.134) Quit (Ping timeout: 480 seconds)
[10:04] * LeaChim (~LeaChim@host86-176-96-249.range86-176.btcentralplus.com) has joined #ceph
[10:04] * i_m (~ivan.miro@deibp9eh1--blueice1n1.emea.ibm.com) Quit (Ping timeout: 480 seconds)
[10:06] * linjan (~linjan@86.62.112.22) has joined #ceph
[10:06] * Miouge (~Miouge@94.136.92.20) Quit (Quit: Miouge)
[10:07] * TMM (~hp@178-84-46-106.dynamic.upc.nl) Quit (Quit: Ex-Chat)
[10:07] * Miouge (~Miouge@94.136.92.20) has joined #ceph
[10:09] * Miouge (~Miouge@94.136.92.20) Quit ()
[10:09] * dynamicudpate (~overonthe@199.68.193.54) Quit (Read error: Connection reset by peer)
[10:09] * boredatwork (~overonthe@199.68.193.62) Quit (Write error: connection closed)
[10:10] * Nicola-1_ (~Nicola-19@x55b598f6.dyn.telefonica.de) Quit (Read error: Connection reset by peer)
[10:10] * dynamicudpate (~overonthe@199.68.193.62) has joined #ceph
[10:10] * jdillaman (~jdillaman@pool-108-18-97-82.washdc.fios.verizon.net) Quit (Read error: Connection reset by peer)
[10:10] * boredatwork (~overonthe@199.68.193.54) has joined #ceph
[10:10] * Miouge (~Miouge@94.136.92.20) has joined #ceph
[10:10] * Nicola-1980 (~Nicola-19@x55b598f6.dyn.telefonica.de) has joined #ceph
[10:11] * rendar (~I@host28-58-dynamic.49-79-r.retail.telecomitalia.it) has joined #ceph
[10:11] * jdillaman (~jdillaman@pool-108-18-97-82.washdc.fios.verizon.net) has joined #ceph
[10:12] * atheism (~atheism@182.48.117.114) Quit (Ping timeout: 480 seconds)
[10:14] * DanFoster (~Daniel@office.34sp.com) has joined #ceph
[10:16] * Zeis (~OODavo@7V7AAEXL5.tor-irc.dnsbl.oftc.net) Quit ()
[10:16] * rakeshgm (~rakesh@121.244.87.117) has joined #ceph
[10:16] * post-factum (~post-fact@vulcan.natalenko.name) Quit (Killed (NickServ (Too many failed password attempts.)))
[10:17] * post-factum (~post-fact@vulcan.natalenko.name) has joined #ceph
[10:17] * Anticime1 is now known as Anticimex
[10:20] * prallab (~prallab@216.207.42.137) has joined #ceph
[10:21] * i_m (~ivan.miro@deibp9eh1--blueice2n4.emea.ibm.com) has joined #ceph
[10:21] * kefu (~kefu@114.92.122.74) Quit (Max SendQ exceeded)
[10:21] * ade (~abradshaw@tmo-108-180.customers.d1-online.com) has joined #ceph
[10:24] * ledgr (~ledgr@88-119-196-104.static.zebra.lt) has joined #ceph
[10:24] * kefu (~kefu@114.92.122.74) has joined #ceph
[10:30] * jordanP (~jordan@92.103.184.178) Quit (Ping timeout: 480 seconds)
[10:33] * penguinRaider (~KiKo@14.139.82.6) Quit (Ping timeout: 480 seconds)
[10:38] * rakeshgm (~rakesh@121.244.87.117) Quit (Ping timeout: 480 seconds)
[10:38] * EinstCra_ (~EinstCraz@58.247.119.250) has joined #ceph
[10:38] * jordanP (~jordan@92.103.184.178) has joined #ceph
[10:40] * evelu (~erwan@37.167.12.22) Quit (Read error: Connection reset by peer)
[10:43] * penguinRaider (~KiKo@146.185.31.226) has joined #ceph
[10:44] * ping (~ping@122.146.93.152) has joined #ceph
[10:45] * EinstCrazy (~EinstCraz@58.247.119.250) Quit (Ping timeout: 480 seconds)
[10:46] * shishi (~BlS@exit1.ipredator.se) has joined #ceph
[10:48] * swami1 (~swami@49.32.0.152) Quit (Quit: Leaving.)
[10:51] * TMM (~hp@185.5.122.2) has joined #ceph
[10:53] * kefu (~kefu@114.92.122.74) Quit (Max SendQ exceeded)
[10:54] * sickolog1 (~mio@vpn.bcs.hr) has joined #ceph
[10:54] * kefu (~kefu@114.92.122.74) has joined #ceph
[10:55] * fdmanana (~fdmanana@2001:8a0:6e0c:6601:6828:63e8:7fe1:76b1) has joined #ceph
[10:56] * evelu (~erwan@37.167.12.22) has joined #ceph
[10:57] * sickology (~mio@vpn.bcs.hr) Quit (Ping timeout: 480 seconds)
[11:06] * penguinRaider (~KiKo@146.185.31.226) Quit (Ping timeout: 480 seconds)
[11:08] * swami1 (~swami@49.32.0.152) has joined #ceph
[11:08] * Nicola-1980 (~Nicola-19@x55b598f6.dyn.telefonica.de) Quit (Quit: Leaving...)
[11:13] * daviddcc (~dcasier@84.197.151.77.rev.sfr.net) Quit (Ping timeout: 480 seconds)
[11:14] * evelu (~erwan@37.167.12.22) Quit (Remote host closed the connection)
[11:15] * evelu (~erwan@37.167.12.22) has joined #ceph
[11:16] * notarima (~Plesioth@06SAACPU3.tor-irc.dnsbl.oftc.net) has joined #ceph
[11:16] * Miouge (~Miouge@94.136.92.20) Quit (Quit: Miouge)
[11:16] * shishi (~BlS@06SAACPTJ.tor-irc.dnsbl.oftc.net) Quit ()
[11:18] * penguinRaider (~KiKo@14.139.82.6) has joined #ceph
[11:18] * Miouge (~Miouge@94.136.92.20) has joined #ceph
[11:27] * onyb (~ani07nov@112.133.232.14) has joined #ceph
[11:28] * dgurtner (~dgurtner@217-162-119-191.dynamic.hispeed.ch) has joined #ceph
[11:32] * ngoswami (~ngoswami@121.244.87.116) has joined #ceph
[11:33] * ping (~ping@122.146.93.152) Quit (Quit: Konversation terminated!)
[11:35] <Kvisle> I just did virsh vol-resize on a rbd volume, and the volume is now filled with 0-bytes ... however, I still have objects on the osd nodes that are filled with data
[11:36] <Kvisle> has anyone seen similar behaviour before?
[11:36] <Kvisle> are there any tricks to make rbd behave?
[11:39] * flisky (~Thunderbi@36.110.40.29) has joined #ceph
[11:39] * penguinRaider (~KiKo@14.139.82.6) Quit (Read error: Connection reset by peer)
[11:39] * wjw-freebsd (~wjw@smtp.digiware.nl) Quit (Ping timeout: 480 seconds)
[11:40] * i_m (~ivan.miro@deibp9eh1--blueice2n4.emea.ibm.com) Quit (Ping timeout: 480 seconds)
[11:42] * chopmann (~sirmonkey@ip4d149312.dynamic.kabel-deutschland.de) has joined #ceph
[11:42] * i_m (~ivan.miro@deibp9eh1--blueice1n6.emea.ibm.com) has joined #ceph
[11:43] * zhaochao_ (~zhaochao@124.202.191.132) has joined #ceph
[11:46] * notarima (~Plesioth@06SAACPU3.tor-irc.dnsbl.oftc.net) Quit ()
[11:46] * Cue (~Snowman@06SAACPV6.tor-irc.dnsbl.oftc.net) has joined #ceph
[11:47] * wjw-freebsd (~wjw@176.74.240.1) has joined #ceph
[11:48] * zhaochao (~zhaochao@125.39.112.4) Quit (Ping timeout: 480 seconds)
[11:49] * zhaochao_ is now known as zhaochao
[11:49] * EinstCra_ (~EinstCraz@58.247.119.250) Quit (Ping timeout: 480 seconds)
[11:52] <vanham> Kvisle, what is the previous size and new size? Did that volume had data before? I'm not sure I understand what the problem is
[11:53] * onyb (~ani07nov@112.133.232.14) Quit (Read error: Connection reset by peer)
[11:55] * vbellur (~vijay@121.244.87.118) Quit (Ping timeout: 480 seconds)
[11:56] * penguinRaider (~KiKo@14.139.82.6) has joined #ceph
[11:56] <Kvisle> vanham: the volume def. had data ... we changed it from 100G to 120G
[11:56] * wgao (~wgao@106.120.101.38) Quit (Read error: Connection timed out)
[11:56] <Kvisle> doing a hexdump of the block device yields mostly zeroes now ... where it previously had 80% utilized
[11:57] <vanham> Okay, now I understand what you meant
[11:57] <vanham> Yeah, shouldn't have happened.
[11:57] * wgao (~wgao@106.120.101.38) has joined #ceph
[11:57] * Miouge (~Miouge@94.136.92.20) Quit (Quit: Miouge)
[11:57] <vanham> No idea here
[12:00] <Kvisle> will try http://ceph.com/planet/ceph-recover-a-rbd-image-from-a-dead-cluster/ on the files that are on the osd related to the volume
[12:01] * hughsaunders (~hughsaund@2001:4800:7817:101:1843:3f8a:80de:df65) has joined #ceph
[12:02] * prallab (~prallab@216.207.42.137) Quit (Remote host closed the connection)
[12:10] * Mika_c (~Mika@122.146.93.152) Quit (Remote host closed the connection)
[12:12] * shyu (~shyu@123.112.68.6) has joined #ceph
[12:14] * rmart04 (~rmart04@support.memset.com) has joined #ceph
[12:16] * Cue (~Snowman@06SAACPV6.tor-irc.dnsbl.oftc.net) Quit ()
[12:16] * rikai1 (~spidu_@4MJAAE9GM.tor-irc.dnsbl.oftc.net) has joined #ceph
[12:30] * karnan (~karnan@121.244.87.117) Quit (Ping timeout: 480 seconds)
[12:31] * Miouge (~Miouge@94.136.92.20) has joined #ceph
[12:36] * Miouge (~Miouge@94.136.92.20) Quit ()
[12:37] * Miouge (~Miouge@94.136.92.20) has joined #ceph
[12:39] * jordanP (~jordan@92.103.184.178) Quit (Ping timeout: 480 seconds)
[12:41] * bene (~bene@2601:18c:8501:41d0:ea2a:eaff:fe08:3c7a) has joined #ceph
[12:46] * rikai1 (~spidu_@4MJAAE9GM.tor-irc.dnsbl.oftc.net) Quit ()
[12:46] * Arfed (~thundercl@tor-exit7-readme.dfri.se) has joined #ceph
[12:52] * T1w (~jens@node3.survey-it.dk) Quit (Remote host closed the connection)
[12:54] * T1w (~jens@node3.survey-it.dk) has joined #ceph
[12:55] * sickolog1 (~mio@vpn.bcs.hr) Quit (Read error: Connection reset by peer)
[12:56] * karnan (~karnan@121.244.87.117) has joined #ceph
[13:01] * sickology (~mio@vpn.bcs.hr) has joined #ceph
[13:12] * bvi (~Bastiaan@185.56.32.1) has joined #ceph
[13:16] * Arfed (~thundercl@4MJAAE9HV.tor-irc.dnsbl.oftc.net) Quit ()
[13:16] * Sophie1 (~bildramer@192.42.115.101) has joined #ceph
[13:17] * jordanP (~jordan@204.13-14-84.ripe.coltfrance.com) has joined #ceph
[13:20] * zhaochao (~zhaochao@124.202.191.132) Quit (Quit: ChatZilla 0.9.92 [Firefox 45.1.1/20160507231935])
[13:22] * prallab (~prallab@216.207.42.137) has joined #ceph
[13:24] * vicente (~~vicente@125-227-238-55.HINET-IP.hinet.net) Quit (Quit: Leaving)
[13:29] * garphy is now known as garphy`aw
[13:30] * madkiss (~madkiss@2001:6f8:12c3:f00f:8d20:b987:d518:c6d1) Quit (Read error: Connection reset by peer)
[13:31] * madkiss (~madkiss@2001:6f8:12c3:f00f:8d20:b987:d518:c6d1) has joined #ceph
[13:38] * ira (~ira@c-24-34-255-34.hsd1.ma.comcast.net) has joined #ceph
[13:39] * jmunhoz (~jmunhoz@14.pool85-61-144.dynamic.orange.es) has joined #ceph
[13:39] * makz (~makz@2a00:d880:6:2d7::e463) has joined #ceph
[13:39] * jmunhoz (~jmunhoz@14.pool85-61-144.dynamic.orange.es) Quit (Read error: Connection reset by peer)
[13:40] * jmunhoz (~jmunhoz@14.pool85-61-144.dynamic.orange.es) has joined #ceph
[13:41] * prallab (~prallab@216.207.42.137) Quit (Remote host closed the connection)
[13:42] * prallab (~prallab@216.207.42.137) has joined #ceph
[13:42] * prallab (~prallab@216.207.42.137) Quit (Remote host closed the connection)
[13:44] * jmunhoz_ (~jmunhoz@233.pool85-61-137.dynamic.orange.es) has joined #ceph
[13:46] * Sophie1 (~bildramer@7V7AAEXT9.tor-irc.dnsbl.oftc.net) Quit ()
[13:46] * cmrn (~Arfed@nl12x.mullvad.net) has joined #ceph
[13:46] * kawa2014 (~kawa@91.73.122.231) has joined #ceph
[13:47] * shohn (~shohn@dslb-146-060-205-153.146.060.pools.vodafone-ip.de) has joined #ceph
[13:49] * shohn1 (~shohn@dslb-178-008-197-199.178.008.pools.vodafone-ip.de) Quit (Ping timeout: 480 seconds)
[13:51] * jmunhoz (~jmunhoz@14.pool85-61-144.dynamic.orange.es) Quit (Ping timeout: 480 seconds)
[13:51] * bara (~bara@nat-pool-brq-t.redhat.com) Quit (Remote host closed the connection)
[13:51] * jmunhoz_ (~jmunhoz@233.pool85-61-137.dynamic.orange.es) Quit (Remote host closed the connection)
[13:52] * shyu (~shyu@123.112.68.6) Quit (Quit: Leaving)
[13:53] * bara (~bara@nat-pool-brq-t.redhat.com) has joined #ceph
[13:55] * bene (~bene@2601:18c:8501:41d0:ea2a:eaff:fe08:3c7a) Quit (Quit: Konversation terminated!)
[13:56] * garphy`aw is now known as garphy
[13:59] <TheSov> anyone else had trouble setting up jewel on ubuntu?
[14:00] * owasserm (~owasserm@2001:984:d3f7:1:5ec5:d4ff:fee0:f6dc) Quit (Quit: Leaving)
[14:00] * owasserm (~owasserm@2001:984:d3f7:1:5ec5:d4ff:fee0:f6dc) has joined #ceph
[14:02] <epicguy> TheSov: i successfully installed jewel on ubuntu 14.04
[14:03] <TheSov> but not 16.04?
[14:03] <TheSov> i can get it to sucessfully build the cluster, but it ignores my OSD's
[14:03] <TheSov> they dont mount
[14:03] <TheSov> basically every osd i add is "down"
[14:03] * rakeshgm (~rakesh@121.244.87.117) has joined #ceph
[14:16] * cmrn (~Arfed@4MJAAE9JV.tor-irc.dnsbl.oftc.net) Quit ()
[14:16] * onyb (~ani07nov@112.133.232.14) has joined #ceph
[14:16] * chopmann (~sirmonkey@ip4d149312.dynamic.kabel-deutschland.de) Quit (Ping timeout: 480 seconds)
[14:18] * evelu (~erwan@37.167.12.22) Quit (Ping timeout: 480 seconds)
[14:20] * oms101 (~oms101@p20030057EA029D00C6D987FFFE4339A1.dip0.t-ipconnect.de) Quit (Ping timeout: 480 seconds)
[14:25] * shyu (~shyu@123.112.68.6) has joined #ceph
[14:28] * evelu (~erwan@37.160.64.142) has joined #ceph
[14:28] * oms101 (~oms101@p20030057EA447300C6D987FFFE4339A1.dip0.t-ipconnect.de) has joined #ceph
[14:29] * bvi (~Bastiaan@185.56.32.1) Quit (Quit: Leaving)
[14:30] * bvi (~Bastiaan@185.56.32.1) has joined #ceph
[14:32] * shyu_ (~shyu@123.112.68.6) has joined #ceph
[14:32] * allaok (~allaok@machine107.orange-labs.com) has joined #ceph
[14:35] * flisky (~Thunderbi@36.110.40.29) Quit (Ping timeout: 480 seconds)
[14:39] * Racpatel (~Racpatel@2601:87:3:3601::6f15) has joined #ceph
[14:39] * Miouge (~Miouge@94.136.92.20) Quit (Quit: Miouge)
[14:40] * shyu (~shyu@123.112.68.6) Quit (Quit: Leaving)
[14:40] * shyu__ (~shyu@123.112.68.6) has joined #ceph
[14:41] * The1_ (~the_one@87.104.212.66) has joined #ceph
[14:41] * evelu (~erwan@37.160.64.142) Quit (Quit: Leaving)
[14:41] * evelu (~erwan@37.160.64.142) has joined #ceph
[14:43] * DaveOD (~DaveOD@nomadesk.com) has joined #ceph
[14:43] * Miouge (~Miouge@94.136.92.20) has joined #ceph
[14:46] * Silentkillzr (~KungFuHam@212.83.40.238) has joined #ceph
[14:46] * shyu_ (~shyu@123.112.68.6) Quit (Quit: Leaving)
[14:46] * shyu (~shyu@123.112.68.6) has joined #ceph
[14:46] * shyu (~shyu@123.112.68.6) Quit ()
[14:47] * shyu (~shyu@123.112.68.6) has joined #ceph
[14:47] * georgem (~Adium@206.108.127.16) has joined #ceph
[14:48] * T1 (~the_one@87.104.212.66) Quit (Ping timeout: 480 seconds)
[14:49] * Miouge (~Miouge@94.136.92.20) Quit (Quit: Miouge)
[14:51] * Miouge (~Miouge@94.136.92.20) has joined #ceph
[14:55] * gopher_49 (~gopher_49@75.66.43.16) has joined #ceph
[14:55] * gopher_49 (~gopher_49@75.66.43.16) Quit (Read error: Connection reset by peer)
[14:55] * winston-d_ (uid98317@id-98317.richmond.irccloud.com) Quit (Quit: Connection closed for inactivity)
[15:00] * TMM (~hp@185.5.122.2) Quit (Quit: Ex-Chat)
[15:01] * wes_dillingham (~wes_dilli@65.112.8.197) has joined #ceph
[15:06] * mhack (~mhack@66-168-117-78.dhcp.oxfr.ma.charter.com) has joined #ceph
[15:06] * valeech (~valeech@pool-108-44-162-111.clppva.fios.verizon.net) has joined #ceph
[15:08] * valeech (~valeech@pool-108-44-162-111.clppva.fios.verizon.net) Quit ()
[15:08] * jowilkin (~jowilkin@nat-pool-rdu-u.redhat.com) has joined #ceph
[15:09] * kawa2014 (~kawa@91.73.122.231) Quit (Quit: Leaving)
[15:09] * shyu__ (~shyu@123.112.68.6) Quit (Ping timeout: 480 seconds)
[15:09] * rdas (~rdas@121.244.87.116) Quit (Ping timeout: 480 seconds)
[15:11] <vanham> gregsfortytwo, hey man, how are you?
[15:12] <vanham> you there?
[15:14] * brad_mssw (~brad@66.129.88.50) has joined #ceph
[15:16] * Silentkillzr (~KungFuHam@7V7AAEXXW.tor-irc.dnsbl.oftc.net) Quit ()
[15:16] * oracular (~rcfighter@7V7AAEXZL.tor-irc.dnsbl.oftc.net) has joined #ceph
[15:16] * wes_dillingham (~wes_dilli@65.112.8.197) Quit (Quit: wes_dillingham)
[15:17] * wes_dillingham (~wes_dilli@65.112.8.197) has joined #ceph
[15:19] * Kioob1 (~Kioob@ALyon-652-1-47-17.w109-213.abo.wanadoo.fr) has joined #ceph
[15:22] * valeech (~valeech@pool-108-44-162-111.clppva.fios.verizon.net) has joined #ceph
[15:22] * valeech (~valeech@pool-108-44-162-111.clppva.fios.verizon.net) Quit ()
[15:23] * rwheeler (~rwheeler@nat-pool-bos-t.redhat.com) has joined #ceph
[15:26] * pabluk_ is now known as pabluk
[15:31] * bniver (~bniver@nat-pool-bos-u.redhat.com) has joined #ceph
[15:35] * swami1 (~swami@49.32.0.152) Quit (Quit: Leaving.)
[15:38] * vbellur (~vijay@122.178.204.198) has joined #ceph
[15:39] * flisky (~Thunderbi@106.37.236.220) has joined #ceph
[15:45] * kefu (~kefu@114.92.122.74) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[15:46] * oracular (~rcfighter@7V7AAEXZL.tor-irc.dnsbl.oftc.net) Quit ()
[15:46] * mLegion (~Esge@7V7AAEX1D.tor-irc.dnsbl.oftc.net) has joined #ceph
[15:52] <epicguy> I'm seriously having a hard time trying to get cbt or CeTune to actually work -_-
[15:53] * shohn1 (~shohn@ipservice-092-208-208-019.092.208.pools.vodafone-ip.de) has joined #ceph
[15:53] * bara_ (~bara@213.175.37.12) has joined #ceph
[15:54] <BranchPredictor> epicguy: then you're not epic :P
[15:54] <epicguy> pffft
[15:55] * bara (~bara@nat-pool-brq-t.redhat.com) Quit (Ping timeout: 480 seconds)
[15:55] * shohn (~shohn@dslb-146-060-205-153.146.060.pools.vodafone-ip.de) Quit (Ping timeout: 480 seconds)
[15:56] * rraja (~rraja@121.244.87.117) Quit (Quit: Leaving)
[15:57] * chopmann (~sirmonkey@ip4d149312.dynamic.kabel-deutschland.de) has joined #ceph
[15:57] * dvanders_ (~dvanders@2001:1458:202:16b::101:124a) has joined #ceph
[15:58] <epicguy> <----- I despise SMR drives
[15:59] * T1w (~jens@node3.survey-it.dk) Quit (Ping timeout: 480 seconds)
[16:00] * bene (~bene@nat-pool-bos-t.redhat.com) has joined #ceph
[16:00] <darkfader> epicguy: hehe :)
[16:01] <darkfader> slow the slow?
[16:01] * dvanders (~dvanders@dvanders-pro.cern.ch) Quit (Ping timeout: 480 seconds)
[16:02] <epicguy> beyond slow like 25mb/s across 45 drives slow :(, bluestore is a huge improvement but bleading edge -_-. Trying to get reports for the bosses lol :D
[16:04] <IcePic> reports sounds like databases, which in turn sounds like stuff you would certainly not run on SMR disks.
[16:05] * yanzheng (~zhyan@125.70.22.41) Quit (Quit: This computer has gone to sleep)
[16:05] <epicguy> IcePic: no I need to make a CeTune Reports so i can point at the sharp decline :)
[16:07] <epicguy> basically we need to store roughly 128MB objects and do lots of reads
[16:08] <epicguy> though these benchmarking tools are doing my head in
[16:09] * flisky (~Thunderbi@106.37.236.220) Quit (Quit: flisky)
[16:09] * karnan (~karnan@121.244.87.117) Quit (Remote host closed the connection)
[16:12] * allaok (~allaok@machine107.orange-labs.com) has left #ceph
[16:14] * wes_dillingham (~wes_dilli@65.112.8.197) Quit (Quit: wes_dillingham)
[16:16] * mLegion (~Esge@7V7AAEX1D.tor-irc.dnsbl.oftc.net) Quit ()
[16:16] * Jebula (~Izanagi@192.87.28.82) has joined #ceph
[16:20] * branto (~branto@nat-pool-brq-t.redhat.com) Quit (Quit: Leaving.)
[16:30] * vikhyat (~vumrao@121.244.87.116) Quit (Quit: Leaving)
[16:31] * wes_dillingham (~wes_dilli@65.112.8.65) has joined #ceph
[16:32] * epicguy (~epicguy@41.164.8.42) Quit (Quit: Leaving)
[16:33] * dvanders (~dvanders@dvanders-pro.cern.ch) has joined #ceph
[16:33] * wgao (~wgao@106.120.101.38) Quit (Read error: Connection timed out)
[16:34] * wgao (~wgao@106.120.101.38) has joined #ceph
[16:35] * prallab (~prallab@223.227.109.120) has joined #ceph
[16:36] * dvanders_ (~dvanders@2001:1458:202:16b::101:124a) Quit (Ping timeout: 480 seconds)
[16:37] * wes_dillingham (~wes_dilli@65.112.8.65) Quit (Quit: wes_dillingham)
[16:38] * prallab_ (~prallab@216.207.42.140) has joined #ceph
[16:38] * prallab_ (~prallab@216.207.42.140) Quit (Remote host closed the connection)
[16:38] * prallab_ (~prallab@216.207.42.140) has joined #ceph
[16:39] * ade (~abradshaw@tmo-108-180.customers.d1-online.com) Quit (Ping timeout: 480 seconds)
[16:41] * prallab (~prallab@223.227.109.120) Quit (Read error: Connection reset by peer)
[16:43] * BrianA (~Brian@c-50-168-46-112.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[16:44] * MentalRay (~MentalRay@MTRLPQ42-1176054809.sdsl.bell.ca) has joined #ceph
[16:45] * alexm (~alexm@000128d2.user.oftc.net) has left #ceph
[16:45] * kefu (~kefu@183.193.181.153) has joined #ceph
[16:45] * shyu (~shyu@123.112.68.6) Quit (Ping timeout: 480 seconds)
[16:46] * Jebula (~Izanagi@7V7AAEX25.tor-irc.dnsbl.oftc.net) Quit ()
[16:46] * anadrom (~richardus@Relay-J.tor-exit.network) has joined #ceph
[16:46] * prallab_ (~prallab@216.207.42.140) Quit (Ping timeout: 480 seconds)
[16:47] * jermudgeon (~jhaustin@gw1.ttp.biz.whitestone.link) has joined #ceph
[16:48] * Kurt (~Adium@2001:628:1:5:8893:f257:1cf2:77bd) Quit (Quit: Leaving.)
[16:50] * kefu_ (~kefu@114.92.122.74) has joined #ceph
[16:51] * joshd1 (~jdurgin@71-92-201-212.dhcp.gldl.ca.charter.com) has joined #ceph
[16:53] <TheSov> wtb working jewel install on ubuntu 16.04
[16:55] * Skaag (~lunix@cpe-172-91-77-84.socal.res.rr.com) Quit (Quit: Leaving.)
[16:55] * vbellur (~vijay@122.178.204.198) Quit (Read error: Connection reset by peer)
[16:55] * ibravo (~ibravo@72.83.69.64) has joined #ceph
[16:56] * kefu (~kefu@183.193.181.153) Quit (Ping timeout: 480 seconds)
[16:58] * valeech (~valeech@mobile-166-171-059-149.mycingular.net) has joined #ceph
[16:58] * valeech (~valeech@mobile-166-171-059-149.mycingular.net) Quit ()
[17:03] * squizzi (~squizzi@107.13.31.195) has joined #ceph
[17:04] * kefu_ is now known as kefu|afk
[17:04] * TMM (~hp@185.5.122.2) has joined #ceph
[17:07] * jproulx (~jon@kvas.csail.mit.edu) has joined #ceph
[17:07] * nils_ (~nils_@doomstreet.collins.kg) Quit (Read error: Connection reset by peer)
[17:08] * ade (~abradshaw@GK-84-46-90-18.routing.wtnet.de) has joined #ceph
[17:11] <- *jproulx* after hammer -> jewel update my rgw is throwing "ERROR: endpoints not configured for upstream zone"
[17:11] <- *jproulx* we've not configured any regions or zone & just have defaults, google's not being very helpful & it can't be as complicated as I'm making it on my own, can anyone point me in the right direction?
[17:11] * vbellur (~vijay@122.172.195.201) has joined #ceph
[17:13] <jproulx> after hammer -> jewel update my rgw is throwing "ERROR: endpoints not configured for upstream zone"
[17:13] <jproulx> we've not configured any regions or zone & just have defaults, google's not being very helpful & it can't be as complicated as I'm making it on my own, can anyone point me in the right direction?
[17:13] * chopmann (~sirmonkey@ip4d149312.dynamic.kabel-deutschland.de) Quit (Quit: chopmann)
[17:15] * aboyle (~aboyle__@ardent.csail.mit.edu) has joined #ceph
[17:16] * anadrom (~richardus@7V7AAEX4F.tor-irc.dnsbl.oftc.net) Quit ()
[17:17] <georgem> jproulx: https://www.mail-archive.com/ceph-users@lists.ceph.com/msg28620.html
[17:17] <jproulx> georgem thx
[17:17] * analbeard (~shw@support.memset.com) Quit (Quit: Leaving.)
[17:21] * sudocat (~dibarra@192.185.1.20) has joined #ceph
[17:21] * ade (~abradshaw@GK-84-46-90-18.routing.wtnet.de) Quit (Quit: Too sexy for his shirt)
[17:21] * ade (~abradshaw@GK-84-46-90-18.routing.wtnet.de) has joined #ceph
[17:21] * LeaChim (~LeaChim@host86-176-96-249.range86-176.btcentralplus.com) Quit (Ping timeout: 480 seconds)
[17:22] * nils_ (~nils_@doomstreet.collins.kg) has joined #ceph
[17:28] * ircolle1 (~Adium@2601:285:201:633a:209a:f864:90b9:843d) has joined #ceph
[17:31] * cathode (~cathode@50.232.215.114) has joined #ceph
[17:31] * LeaChim (~LeaChim@host86-176-96-249.range86-176.btcentralplus.com) has joined #ceph
[17:32] * jcsp (~jspray@82-71-16-249.dsl.in-addr.zen.co.uk) has left #ceph
[17:32] * jcsp (~jspray@82-71-16-249.dsl.in-addr.zen.co.uk) has joined #ceph
[17:33] * dugravot6 (~dugravot6@dn-infra-04.lionnois.site.univ-lorraine.fr) Quit (Ping timeout: 480 seconds)
[17:33] * Skaag (~lunix@65.200.54.234) has joined #ceph
[17:35] * ircolle (~Adium@c-71-229-136-109.hsd1.co.comcast.net) Quit (Ping timeout: 480 seconds)
[17:35] * TomasCZ (~TomasCZ@yes.tenlab.net) has joined #ceph
[17:39] * DanFoster (~Daniel@office.34sp.com) Quit (Quit: Leaving)
[17:40] * vata (~vata@207.96.182.162) has joined #ceph
[17:46] * notarima (~Peaced@104.40.1.143) has joined #ceph
[17:51] * wes_dillingham (~wes_dilli@65.112.8.195) has joined #ceph
[17:54] * notarima (~Peaced@7V7AAEX7S.tor-irc.dnsbl.oftc.net) Quit (Ping timeout: 480 seconds)
[17:57] * kefu|afk (~kefu@114.92.122.74) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[17:58] * kefu (~kefu@183.193.181.153) has joined #ceph
[18:00] * pdrakeweb (~pdrakeweb@cpe-65-185-74-239.neo.res.rr.com) has joined #ceph
[18:01] * bara (~bara@nat-pool-brq-t.redhat.com) has joined #ceph
[18:03] * ircolle1 (~Adium@2601:285:201:633a:209a:f864:90b9:843d) Quit (Quit: Leaving.)
[18:03] * derjohn_mob (~aj@fw.gkh-setu.de) Quit (Ping timeout: 480 seconds)
[18:03] * kefu_ (~kefu@li331-26.members.linode.com) has joined #ceph
[18:04] * bara (~bara@nat-pool-brq-t.redhat.com) Quit ()
[18:06] * joshd1 (~jdurgin@71-92-201-212.dhcp.gldl.ca.charter.com) Quit (Quit: Leaving.)
[18:07] * bara_ (~bara@213.175.37.12) Quit (Ping timeout: 480 seconds)
[18:07] * Brochacho (~alberto@c-73-45-127-198.hsd1.il.comcast.net) has joined #ceph
[18:07] * pdrakewe_ (~pdrakeweb@cpe-65-185-74-239.neo.res.rr.com) Quit (Ping timeout: 480 seconds)
[18:08] * kefu (~kefu@183.193.181.153) Quit (Ping timeout: 480 seconds)
[18:08] * pdrakeweb (~pdrakeweb@cpe-65-185-74-239.neo.res.rr.com) Quit (Ping timeout: 480 seconds)
[18:09] * wjw-freebsd (~wjw@176.74.240.1) Quit (Ping timeout: 480 seconds)
[18:11] * jowilkin (~jowilkin@nat-pool-rdu-u.redhat.com) Quit (Ping timeout: 480 seconds)
[18:13] * kefu (~kefu@114.92.122.74) has joined #ceph
[18:13] * dgurtner_ (~dgurtner@82.199.64.68) has joined #ceph
[18:13] * TMM (~hp@185.5.122.2) Quit (Quit: Ex-Chat)
[18:13] * i_m (~ivan.miro@deibp9eh1--blueice1n6.emea.ibm.com) Quit (Ping timeout: 480 seconds)
[18:15] * linuxkidd (~linuxkidd@227.sub-70-210-224.myvzw.com) has joined #ceph
[18:15] * dgurtner (~dgurtner@217-162-119-191.dynamic.hispeed.ch) Quit (Ping timeout: 480 seconds)
[18:15] * kefu (~kefu@114.92.122.74) Quit (Max SendQ exceeded)
[18:17] * kefu_ (~kefu@li331-26.members.linode.com) Quit (Ping timeout: 480 seconds)
[18:18] * vasu (~vasu@c-73-231-60-138.hsd1.ca.comcast.net) has joined #ceph
[18:21] * kefu (~kefu@183.193.181.153) has joined #ceph
[18:25] * newbie (~kvirc@host217-114-156-249.pppoe.mark-itt.net) has joined #ceph
[18:27] * BrianA (~Brian@c-50-168-46-112.hsd1.ca.comcast.net) has joined #ceph
[18:27] * jermudgeon (~jhaustin@gw1.ttp.biz.whitestone.link) Quit (Quit: jermudgeon)
[18:38] * dneary (~dneary@nat-pool-bos-u.redhat.com) Quit (Ping timeout: 480 seconds)
[18:38] * mrapple1 (~SinZ|offl@chomsky.torservers.net) has joined #ceph
[18:38] * jordanP (~jordan@204.13-14-84.ripe.coltfrance.com) Quit (Quit: Leaving)
[18:39] * wes_dillingham (~wes_dilli@65.112.8.195) Quit (Quit: wes_dillingham)
[18:39] * sbfox (~Adium@vancouver.xmatters.com) has joined #ceph
[18:39] * sbfox (~Adium@vancouver.xmatters.com) Quit ()
[18:43] * swami1 (~swami@27.7.168.167) has joined #ceph
[18:44] * mtanski (~mtanski@65.244.82.98) has left #ceph
[18:46] * karnan (~karnan@106.51.142.125) has joined #ceph
[18:47] * dneary (~dneary@nat-pool-bos-t.redhat.com) has joined #ceph
[18:48] * derjohn_mob (~aj@tmo-110-166.customers.d1-online.com) has joined #ceph
[18:50] * pabluk is now known as pabluk_
[18:54] * squizzi (~squizzi@107.13.31.195) Quit (Ping timeout: 480 seconds)
[18:59] * kefu (~kefu@183.193.181.153) Quit (Ping timeout: 480 seconds)
[19:01] * squizzi (~squizzi@107.13.31.195) has joined #ceph
[19:02] * squizzi (~squizzi@107.13.31.195) Quit ()
[19:02] * squizzi (~squizzi@107.13.31.195) has joined #ceph
[19:03] * derjohn_mob (~aj@tmo-110-166.customers.d1-online.com) Quit (Ping timeout: 480 seconds)
[19:06] * Kioob1 (~Kioob@ALyon-652-1-47-17.w109-213.abo.wanadoo.fr) Quit (Quit: Leaving.)
[19:06] * davidz (~davidz@2605:e000:1313:8003:b879:4839:7d23:fb27) Quit (Quit: Leaving.)
[19:06] * jowilkin (~jowilkin@rrcs-70-60-101-195.midsouth.biz.rr.com) has joined #ceph
[19:08] * mrapple1 (~SinZ|offl@7V7AAEYAN.tor-irc.dnsbl.oftc.net) Quit ()
[19:08] * CoZmicShReddeR (~Guest1390@Relay-J.tor-exit.network) has joined #ceph
[19:09] * gmmaha (~gmmaha@162.243.31.130) has joined #ceph
[19:13] * garphy is now known as garphy`aw
[19:13] * jermudgeon (~jhaustin@wpc-pe-l2.whitestone.link) has joined #ceph
[19:15] * jermudgeon (~jhaustin@wpc-pe-l2.whitestone.link) Quit ()
[19:16] * wes_dillingham (~wes_dilli@140.247.242.44) has joined #ceph
[19:17] * bvi (~Bastiaan@185.56.32.1) Quit (Quit: Leaving)
[19:22] * swami1 (~swami@27.7.168.167) Quit (Quit: Leaving.)
[19:22] * mykola (~Mikolaj@91.245.78.82) has joined #ceph
[19:25] * davidz (~davidz@2605:e000:1313:8003:3126:a584:6612:fc01) has joined #ceph
[19:27] * johnavp1989 (~jpetrini@8.39.115.8) has joined #ceph
[19:27] <- *johnavp1989* To prove that you are human, please enter the result of 8+3
[19:27] * davidz (~davidz@2605:e000:1313:8003:3126:a584:6612:fc01) Quit ()
[19:27] * johnavp1989 (~jpetrini@8.39.115.8) Quit ()
[19:30] * ledgr (~ledgr@88-119-196-104.static.zebra.lt) Quit (Remote host closed the connection)
[19:31] * vbellur1 (~vijay@122.172.225.7) has joined #ceph
[19:32] * vbellur (~vijay@122.172.195.201) Quit (Ping timeout: 480 seconds)
[19:33] * fdmanana (~fdmanana@2001:8a0:6e0c:6601:6828:63e8:7fe1:76b1) Quit (Ping timeout: 480 seconds)
[19:34] * jowilkin (~jowilkin@rrcs-70-60-101-195.midsouth.biz.rr.com) Quit (Ping timeout: 480 seconds)
[19:38] * CoZmicShReddeR (~Guest1390@4MJAAE9YF.tor-irc.dnsbl.oftc.net) Quit ()
[19:38] * ricin (~Nephyrin@torland1-this.is.a.tor.exit.server.torland.is) has joined #ceph
[19:39] * rakeshgm (~rakesh@121.244.87.117) Quit (Quit: Leaving)
[19:40] * shaunm (~shaunm@74.83.215.100) Quit (Ping timeout: 480 seconds)
[19:40] * shylesh (~shylesh@45.124.226.68) has joined #ceph
[19:49] * Be-El (~blinke@nat-router.computational.bio.uni-giessen.de) Quit (Quit: Leaving.)
[19:49] * rotbeard (~redbeard@185.32.80.238) Quit (Quit: Leaving)
[19:49] * garphy`aw is now known as garphy
[19:56] * TMM (~hp@178-84-46-106.dynamic.upc.nl) has joined #ceph
[19:59] * rmart04 (~rmart04@support.memset.com) Quit (Ping timeout: 480 seconds)
[20:00] * bniver (~bniver@nat-pool-bos-u.redhat.com) Quit (Remote host closed the connection)
[20:03] * vbellur1 (~vijay@122.172.225.7) Quit (Ping timeout: 480 seconds)
[20:06] * jowilkin (~jowilkin@nat-pool-rdu-u.redhat.com) has joined #ceph
[20:08] * ricin (~Nephyrin@06SAACQJC.tor-irc.dnsbl.oftc.net) Quit ()
[20:08] * Kyso_ (~nastidon@7V7AAEYFV.tor-irc.dnsbl.oftc.net) has joined #ceph
[20:09] <kiranos> Do you have ceph monitors on the cluster iprange or the public ip range? it feels safer to have it on the not routed cluster network
[20:09] <kiranos> as the public network is prune to network missconfigurations etc
[20:10] <kiranos> the cluster network is isolated to all else if you follow best practice so I feel it would be better to have monitors on this network instead
[20:11] <kiranos> but then hm what will the public network be used for
[20:12] <neurodrone> MON and OSD <-> client happens on public, OSD <-> OSD is the only thing supposed to happen on cluster.
[20:13] <kiranos> but osd are supposted to report in to the monitor once in a while so the cluster is dependent on the public network
[20:14] <neurodrone> Public is core. Cluster is an addition, especially in the cases where you don???t need replication traffic to collide with the rest.
[20:14] * shylesh (~shylesh@45.124.226.68) Quit (Ping timeout: 480 seconds)
[20:18] * ledgr (~ledgr@88-222-11-185.meganet.lt) has joined #ceph
[20:21] * squizzi (~squizzi@107.13.31.195) Quit (Remote host closed the connection)
[20:24] <kiranos> neurodrone: so you should have a third network for repo updates etc?
[20:24] <kiranos> ie internet access
[20:25] <neurodrone> It can be a part of public or a separate one. For repo updates public should be fine if you have an internal aptly or something.
[20:25] * squizzi (~squizzi@107.13.31.195) has joined #ceph
[20:26] * ledgr (~ledgr@88-222-11-185.meganet.lt) Quit (Ping timeout: 480 seconds)
[20:28] * smev (~smev@d23-17-52-141.abhsia.telus.net) Quit (Ping timeout: 480 seconds)
[20:30] * stiopa (~stiopa@cpc73832-dals21-2-0-cust453.20-2.cable.virginm.net) has joined #ceph
[20:31] * gmmaha (~gmmaha@00021e7e.user.oftc.net) Quit (Remote host closed the connection)
[20:33] * lcurtis (~lcurtis@47.19.105.250) has joined #ceph
[20:34] * branto (~branto@178-253-141-245.3pp.slovanet.sk) has joined #ceph
[20:38] * Kyso_ (~nastidon@7V7AAEYFV.tor-irc.dnsbl.oftc.net) Quit ()
[20:38] * tallest_red (~Sliker@7V7AAEYHG.tor-irc.dnsbl.oftc.net) has joined #ceph
[20:39] * ledgr (~ledgr@88-222-11-185.meganet.lt) has joined #ceph
[20:40] * overclk (~quassel@117.202.96.197) Quit (Remote host closed the connection)
[20:43] <TheSov> does anyone have any clue on getting ceph jewel working on ubuntu
[20:43] <TheSov> there seems to be something wrong in the OSD process
[20:43] * gmmaha (~gmmaha@162.243.31.130) has joined #ceph
[20:44] * sickology (~mio@vpn.bcs.hr) Quit (Read error: Connection reset by peer)
[20:44] * sickology (~mio@vpn.bcs.hr) has joined #ceph
[20:44] <jproulx> TheSov: http://docs.ceph.com/docs/master/release-notes/ "Ceph daemons now run as user and group ceph by default."
[20:44] <TheSov> i know
[20:45] <TheSov> that isnt the issue
[20:45] <jproulx> did you chown everything or set the config option 'setuser match path'?
[20:45] <TheSov> the issue is when i create an osd via ceph-deploy osd create --blustore ceph-server:datadisk it does nothing.
[20:46] <jproulx> OK I just ran the upgrade but haven't tried any new osds yet (buch less bluestore)
[20:47] <vasu> TheSov: I dont think ceph-deploy with bluestore works
[20:47] <TheSov> vasu, well that would explain it
[20:47] <TheSov> it shows the disk as added to the ceph cluster in ceph osd tree
[20:47] <TheSov> but there are no mount points
[20:47] <TheSov> and if i create one
[20:47] <TheSov> and mount it
[20:48] <TheSov> it shows as down anyway
[20:48] <TheSov> are bluestores supposed to be a mounted disk?
[20:48] <vasu> yeah i have seen that as well, i believe it works when configured manually
[20:49] <vasu> TheSov: dont know much about bluestore
[20:53] <neurodrone> TheSov: working fine for me on trusty.
[20:53] <neurodrone> Ah, but without bluestore. Believe it???s still ???experimental??? for using it in prod.
[20:54] <neurodrone> Anyone worked with provisioning multiple OSDs on a single disk?
[20:54] <neurodrone> It should be possible technically, but looks like no one has tried it?
[20:55] <[arx]> what would you gain by doing so?
[20:56] <neurodrone> Improve disk utilization. A single OSD is barely stressing them.
[20:56] <rkeene> neurodrone, What would be the problem with doing so ? It would work
[20:57] <neurodrone> rkeene: The default tooling doesn???t seem to be designed for such a thing.
[20:57] <rkeene> I don't use the default tooling
[20:57] <neurodrone> Speaking about ceph-deploy, ceph-disk et al.
[20:57] <neurodrone> What do you use?
[20:57] <rkeene> I have a tool called ceph-automountd that looks for disks to convert to OSDs and mounts/decrypts/setsup RAID1 (if too few OSDs)/etc
[20:59] <rkeene> https://development.cloudseed.knightpoint.com/artifact/b403c41c09862b18f1eab158826dfa7d7b31c593?txt=1&ln=0
[20:59] <neurodrone> That sounds like one OSD on multiple raided disks.
[20:59] <neurodrone> I am looking for something opposite.
[20:59] <rkeene> Right, I don't do the opposite but there's nothing that wouldn't work
[21:00] <neurodrone> rkeene: I like that you have your own process for this.
[21:00] <neurodrone> Much easy to customize when need be.
[21:00] * dgurtner_ (~dgurtner@82.199.64.68) Quit (Ping timeout: 480 seconds)
[21:00] * dillaman (~jdillaman@pool-108-18-97-82.washdc.fios.verizon.net) Quit (Quit: Leaving)
[21:01] * ircolle (~Adium@2601:285:201:633a:209a:f864:90b9:843d) has joined #ceph
[21:02] <rkeene> Yeah
[21:02] <neurodrone> What do you use for FDE? I don???t believe you use dmcrypt?
[21:03] <rkeene> I'm using dm-crypt, with a custom setup
[21:03] <rkeene> https://development.cloudseed.knightpoint.com/artifact/53bee515fe1a2cb85cb4952c2af6e1a4a1fb29a3?txt=1&ln=0
[21:04] <neurodrone> rkeene: That???s pretty rad. Thanks for the share!
[21:04] * ledgr (~ledgr@88-222-11-185.meganet.lt) Quit (Remote host closed the connection)
[21:04] <rkeene> Reads/updates a header on a disk with an AES key encrypted with the public key from many RSA keys -- when its time to decrypt, it sends the encrypted header to a daemon that decrypts it with a smartcard
[21:05] <rkeene> I added my disk header magic bytes to libblkid, and it's plugged into the ceph-automountd process so that encrypted disks are decrypted if found
[21:05] <neurodrone> Do you house the keys in a local lockbox like what Jewel does?
[21:05] <rkeene> Hmm ?
[21:06] <rkeene> The private keys are on a smartcard and cannot be read
[21:06] * rwheeler (~rwheeler@nat-pool-bos-t.redhat.com) Quit (Remote host closed the connection)
[21:06] <neurodrone> I see.
[21:06] <rkeene> The public keys are in a "shared" filesystem (really a DVCS -- with hooks so when values change things happen -- so if keys change then disks headers are all rewritten)
[21:07] <neurodrone> Beautiful. I like this whole thing!
[21:07] * thomnico (~thomnico@37.163.245.252) has joined #ceph
[21:08] * tallest_red (~Sliker@7V7AAEYHG.tor-irc.dnsbl.oftc.net) Quit ()
[21:08] * Nanobot (~Jase@7V7AAEYIK.tor-irc.dnsbl.oftc.net) has joined #ceph
[21:09] <rkeene> Me too :-D
[21:09] <rkeene> I have 3 smartcards, one attached to each monitor node
[21:10] <rkeene> And then there's also a public key in the list that doesn't have a cooresponding smartcard -- its private key is printed out on paper as a QR code, it's a failsafe in case we lose all 3 smartcards we can still recover our data
[21:11] <rkeene> Swapping out the smartcards updates the list of public keys in the "shared" filesystem, which triggers updating the header on each encrypted disk (by ceph-automountd, actually, so it doesn't interfere with that process) with the disk's AES key encrypted with the new key
[21:12] <neurodrone> Revoking keys look to be a much easier endeavor in your case.
[21:13] * ledgr (~ledgr@88-222-11-185.meganet.lt) has joined #ceph
[21:14] * ledgr (~ledgr@88-222-11-185.meganet.lt) Quit (Remote host closed the connection)
[21:14] * ledgr (~ledgr@88-119-196-104.static.zebra.lt) has joined #ceph
[21:15] <rkeene> If you remove a smartcard then the key will be removed and all headers will be updated -- it checks every hour
[21:15] <rkeene> https://development.cloudseed.knightpoint.com/artifact/3b5bd95917fcab77ae1bbdb032d1fcd558604ab5?txt=1&ln=0
[21:15] * jermudgeon (~jhaustin@wpc-pe-l2.whitestone.link) has joined #ceph
[21:17] <rkeene> Disk encryption isn't enabled by default -- you enable it by telling it the smartcard PIN in the "shared" filesystem, the hook for that then starts the daemon which writes the keys out
[21:18] * davidzlap (~Adium@cpe-172-91-154-245.socal.res.rr.com) has joined #ceph
[21:21] * Brochacho (~alberto@c-73-45-127-198.hsd1.il.comcast.net) Quit (Quit: Brochacho)
[21:21] <rkeene> Enabling it doesn't touch existing disks, obviously... but you can decom an OSD and it'll get picked back up and encrypted. I'm in the process of doing that now for one my clusters.
[21:25] <rkeene> It's one of the 2 main new features in the new release of my distribution. DAR encryption for OSDs and a fancy VM snapshotting system -- it reads in a specifier like: weeky:local=4,remote=13,archive=13@Fri and takes a snapshot of the VM that attribute is associated with every week on Friday and keeps 4 copies in the local Ceph, 13 copies in a remote Ceph (contacted via SSH), and 13 copies in Amazon S3/Glacier (encrypted with the same keys as the disks)
[21:27] * jermudgeon (~jhaustin@wpc-pe-l2.whitestone.link) Quit (Quit: jermudgeon)
[21:28] * bniver (~bniver@71-9-144-29.static.oxfr.ma.charter.com) has joined #ceph
[21:28] * bstillwell (~bryan@bokeoa.com) Quit (Quit: leaving)
[21:29] * bstillwell (~bryan@bokeoa.com) has joined #ceph
[21:32] * shaunm (~shaunm@74.83.215.100) has joined #ceph
[21:33] * jclm (~jclm@ip68-96-198-45.lv.lv.cox.net) Quit (Quit: Leaving.)
[21:34] * smev (~smev@d23-17-52-141.abhsia.telus.net) has joined #ceph
[21:37] * smev (~smev@d23-17-52-141.abhsia.telus.net) has left #ceph
[21:38] * Nanobot (~Jase@7V7AAEYIK.tor-irc.dnsbl.oftc.net) Quit ()
[21:38] * hifi1 (~OODavo@0.tor.exit.babylon.network) has joined #ceph
[21:38] * wjw-freebsd (~wjw@smtp.digiware.nl) has joined #ceph
[21:41] * jermudgeon (~jhaustin@wpc-pe-l2.whitestone.link) has joined #ceph
[21:43] * branto (~branto@178-253-141-245.3pp.slovanet.sk) Quit (Quit: Leaving.)
[21:43] * jermudgeon (~jhaustin@wpc-pe-l2.whitestone.link) Quit ()
[21:49] * jowilkin (~jowilkin@nat-pool-rdu-u.redhat.com) Quit (Ping timeout: 480 seconds)
[21:50] * daviddcc (~dcasier@84.197.151.77.rev.sfr.net) has joined #ceph
[21:56] * penguinRaider (~KiKo@14.139.82.6) Quit (Ping timeout: 480 seconds)
[21:56] * ade (~abradshaw@GK-84-46-90-18.routing.wtnet.de) Quit (Quit: Too sexy for his shirt)
[21:56] * wes_dillingham (~wes_dilli@140.247.242.44) Quit (Quit: wes_dillingham)
[22:00] * thomnico (~thomnico@37.163.245.252) Quit (Ping timeout: 480 seconds)
[22:06] * penguinRaider (~KiKo@146.185.31.226) has joined #ceph
[22:08] * hifi1 (~OODavo@06SAACQOW.tor-irc.dnsbl.oftc.net) Quit ()
[22:08] * jacoo (~Dragonsha@06SAACQP4.tor-irc.dnsbl.oftc.net) has joined #ceph
[22:11] * jermudgeon (~jhaustin@wpc-pe-l2.whitestone.link) has joined #ceph
[22:12] * ngoswami (~ngoswami@121.244.87.116) Quit (Quit: Leaving)
[22:12] * jermudgeon (~jhaustin@wpc-pe-l2.whitestone.link) Quit ()
[22:13] * efirs (~firs@c-50-185-70-125.hsd1.ca.comcast.net) has joined #ceph
[22:14] * tobiash (~quassel@212.118.206.70) Quit (Quit: No Ping reply in 180 seconds.)
[22:15] * tobiash (~quassel@212.118.206.70) has joined #ceph
[22:16] * rendar (~I@host28-58-dynamic.49-79-r.retail.telecomitalia.it) Quit (Ping timeout: 480 seconds)
[22:20] * georgem (~Adium@206.108.127.16) Quit (Quit: Leaving.)
[22:20] * nils_ (~nils_@doomstreet.collins.kg) Quit (Quit: This computer has gone to sleep)
[22:21] * karnan (~karnan@106.51.142.125) Quit (Read error: Connection reset by peer)
[22:23] * wes_dillingham (~wes_dilli@140.247.242.44) has joined #ceph
[22:24] * BrianA (~Brian@c-50-168-46-112.hsd1.ca.comcast.net) has left #ceph
[22:27] * derjohn_mob (~aj@88.128.80.75) has joined #ceph
[22:29] * Racpatel (~Racpatel@2601:87:3:3601::6f15) Quit (Ping timeout: 480 seconds)
[22:32] <gregsfortytwo> vanham: just trying to look at the log you uploaded and the gz file got corrupted somehow
[22:33] <gregsfortytwo> if it's still good on your end, try reposting it?
[22:33] * mykola (~Mikolaj@91.245.78.82) Quit (Quit: away)
[22:35] * georgem (~Adium@24.114.67.121) has joined #ceph
[22:35] * linuxkidd_ (~linuxkidd@166.170.49.162) has joined #ceph
[22:36] * georgem (~Adium@24.114.67.121) Quit ()
[22:36] * georgem (~Adium@206.108.127.16) has joined #ceph
[22:38] * jacoo (~Dragonsha@06SAACQP4.tor-irc.dnsbl.oftc.net) Quit ()
[22:38] * Nanobot (~Phase@kunstler.tor-exit.calyxinstitute.org) has joined #ceph
[22:39] * newbie (~kvirc@host217-114-156-249.pppoe.mark-itt.net) Quit (Ping timeout: 480 seconds)
[22:40] * derjohn_mob (~aj@88.128.80.75) Quit (Ping timeout: 480 seconds)
[22:41] * wes_dillingham (~wes_dilli@140.247.242.44) Quit (Ping timeout: 480 seconds)
[22:42] * rendar (~I@host28-58-dynamic.49-79-r.retail.telecomitalia.it) has joined #ceph
[22:42] * linuxkidd (~linuxkidd@227.sub-70-210-224.myvzw.com) Quit (Ping timeout: 480 seconds)
[22:44] * georgem1 (~Adium@24.114.67.121) has joined #ceph
[22:45] * georgem1 (~Adium@24.114.67.121) Quit ()
[22:45] * georgem1 (~Adium@206.108.127.16) has joined #ceph
[22:47] * georgem (~Adium@206.108.127.16) Quit (Read error: Connection reset by peer)
[22:47] * ircolle (~Adium@2601:285:201:633a:209a:f864:90b9:843d) Quit (Quit: Leaving.)
[23:01] * Racpatel (~Racpatel@2601:87:3:3601::6f15) has joined #ceph
[23:05] * bene (~bene@nat-pool-bos-t.redhat.com) Quit (Quit: Konversation terminated!)
[23:07] * evelu (~erwan@37.160.64.142) Quit (Read error: Connection reset by peer)
[23:07] * onyb (~ani07nov@112.133.232.14) Quit (Quit: raise SystemExit())
[23:07] * efirs (~firs@c-50-185-70-125.hsd1.ca.comcast.net) Quit (Quit: Leaving.)
[23:08] * Nanobot (~Phase@4MJAAE97I.tor-irc.dnsbl.oftc.net) Quit ()
[23:08] * dusti (~Zeis@exit1.ipredator.se) has joined #ceph
[23:13] * brad_mssw (~brad@66.129.88.50) Quit (Quit: Leaving)
[23:14] * Racpatel (~Racpatel@2601:87:3:3601::6f15) Quit (Quit: Leaving)
[23:18] * georgem (~Adium@206.108.127.16) has joined #ceph
[23:18] * georgem1 (~Adium@206.108.127.16) Quit (Read error: Connection reset by peer)
[23:19] * ledgr (~ledgr@88-119-196-104.static.zebra.lt) Quit (Remote host closed the connection)
[23:20] * fdmanana (~fdmanana@2001:8a0:6e0c:6601:6828:63e8:7fe1:76b1) has joined #ceph
[23:21] * evelu (~erwan@37.160.64.142) has joined #ceph
[23:24] * ntpttr (~ntpttr@jfdmzpr05-ext.jf.intel.com) has joined #ceph
[23:32] * rdias (~rdias@2001:8a0:749a:d01:591d:9289:9c4:fbb1) Quit (Ping timeout: 480 seconds)
[23:32] * georgem (~Adium@206.108.127.16) Quit (Quit: Leaving.)
[23:34] <infernix> can 'alg straw' coexist with 'alg straw2' in the same crushmap?
[23:35] <infernix> e.g. can i migrate to staw2 per host, or does it have to be an all-at-once change?
[23:36] * rdias (~rdias@2001:8a0:749a:d01:6c82:bf76:7e88:6bd0) has joined #ceph
[23:37] <vanham> gregsfortytwo, in a few
[23:37] <vanham> right away
[23:38] * dusti (~Zeis@4MJAAE98R.tor-irc.dnsbl.oftc.net) Quit ()
[23:38] * Zeis (~Sun7zu@tor01.zencurity.dk) has joined #ceph
[23:38] <via> anyone /win 28
[23:38] <via> shit
[23:42] * grauzikas (grauzikas@78-56-222-78.static.zebra.lt) Quit (Ping timeout: 480 seconds)
[23:44] <vanham> gregsfortytwo, ceph-post-file: 86238dec-a35e-49f6-91f3-9efa496d59b7
[23:44] <vanham> integrity ok
[23:45] * dis (~dis@00018d20.user.oftc.net) Quit (Ping timeout: 480 seconds)
[23:49] * rdias (~rdias@2001:8a0:749a:d01:6c82:bf76:7e88:6bd0) Quit (Ping timeout: 480 seconds)
[23:51] * derjohn_mob (~aj@x4db1c408.dyn.telefonica.de) has joined #ceph
[23:56] * bniver (~bniver@71-9-144-29.static.oxfr.ma.charter.com) Quit (Remote host closed the connection)
[23:58] * jermudgeon (~jhaustin@wpc-pe-l2.whitestone.link) has joined #ceph

These logs were automatically created by CephLogBot on irc.oftc.net using the Java IRC LogBot.