#ceph IRC Log

Index

IRC Log for 2016-01-06

Timestamps are in GMT/BST.

[16:55] -coulomb.oftc.net- *** Looking up your hostname...
[16:55] -coulomb.oftc.net- *** Checking Ident
[16:55] -coulomb.oftc.net- *** Couldn't look up your hostname
[16:55] -coulomb.oftc.net- *** No Ident response
[16:55] * CephLogBot (~PircBot@92.63.168.213) has joined #ceph
[16:55] * Topic is 'http://ceph.com/get || dev channel #ceph-devel || test lab channel #sepia'
[16:55] * Set by scuttlemonkey!~scuttle@nat-pool-rdu-t.redhat.com on Mon Sep 07 00:44:10 CEST 2015
[16:56] * wido_ (~wido@92.63.168.213) has joined #ceph
[17:00] * mattbenjamin (~mbenjamin@76-206-42-50.lightspeed.livnmi.sbcglobal.net) Quit (Ping timeout: 480 seconds)
[17:01] * haomaiwang (~haomaiwan@li745-113.members.linode.com) Quit (Remote host closed the connection)
[17:01] * haomaiwang (~haomaiwan@li745-113.members.linode.com) has joined #ceph
[17:01] * vata (~vata@207.96.182.162) has joined #ceph
[17:02] * rogierm__ (~rogierm@095-097-129-154.static.chello.nl) Quit (Remote host closed the connection)
[17:03] * analbeard (~shw@support.memset.com) Quit (Quit: Leaving.)
[17:07] * dyasny__ (~dyasny@dsl.dynamic-189-116-74-225.electronicbox.net) has joined #ceph
[17:07] * haomaiwang (~haomaiwan@li745-113.members.linode.com) Quit (Remote host closed the connection)
[17:08] * LobsterRoll (~LobsterRo@140.247.242.44) has joined #ceph
[17:08] * rogierm (~rogierm@095-097-129-154.static.chello.nl) has joined #ceph
[17:11] * jclm1 (~jclm@155.94.171.151) has joined #ceph
[17:11] * dyasny_ (~dyasny@dsl.198.58.155.245.ebox.ca) Quit (Ping timeout: 480 seconds)
[17:11] * Offerlam (~kvirc@static-5-103-131-129.seas-nve.net) Quit (Quit: KVIrc 4.2.0 Equilibrium http://www.kvirc.net/)
[17:12] * ngoswami (~ngoswami@121.244.87.116) Quit (Quit: Leaving)
[17:14] * zack_dolby (~textual@paafe4c.tokynt01.ap.so-net.ne.jp) has joined #ceph
[17:14] * moore (~moore@64.202.160.88) has joined #ceph
[17:15] * mykola (~Mikolaj@91.225.200.174) Quit (Ping timeout: 480 seconds)
[17:15] * jclm (~jclm@23.105.21.33) Quit (Ping timeout: 480 seconds)
[17:16] * ron-slc (~Ron@173-165-129-118-utah.hfc.comcastbusiness.net) has joined #ceph
[17:22] * mattbenjamin (~mbenjamin@aa2.linuxbox.com) has joined #ceph
[17:24] * allaok (~allaok@machine107.orange-labs.com) has left #ceph
[17:26] * branto1 (~branto@nat-pool-brq-t.redhat.com) Quit (Quit: Leaving.)
[17:29] * dgurtner (~dgurtner@178.197.231.6) Quit (Ping timeout: 480 seconds)
[17:29] * mykola (~Mikolaj@91.225.200.174) has joined #ceph
[17:31] * bene2 (~bene@nat-pool-bos-t.redhat.com) Quit (Quit: Konversation terminated!)
[17:32] * bene_in_mtg (~bene@nat-pool-bos-t.redhat.com) has joined #ceph
[17:32] * kefu (~kefu@114.92.107.250) has joined #ceph
[17:33] * TMM (~hp@sams-office-nat.tomtomgroup.com) Quit (Quit: Ex-Chat)
[17:34] * dyasny_ (~dyasny@dsl.dynamic.190-116-74-123.electronicbox.net) has joined #ceph
[17:35] <TheSov3> has anyone tried to build ceph on raids and run a size 1, hows the performance on it?
[17:37] * thomnico (~thomnico@2a01:e35:8b41:120:c412:e11e:abf8:9a33) Quit (Quit: Ex-Chat)
[17:38] * dyasny__ (~dyasny@dsl.dynamic-189-116-74-225.electronicbox.net) Quit (Ping timeout: 480 seconds)
[17:39] * fghaas (~florian@91-119-120-46.dynamic.xdsl-line.inode.at) Quit (Ping timeout: 480 seconds)
[17:39] * mykola (~Mikolaj@91.225.200.174) Quit (Ping timeout: 480 seconds)
[17:40] * mykola (~Mikolaj@91.225.200.174) has joined #ceph
[17:41] * alram (~alram@cpe-172-250-2-46.socal.res.rr.com) has joined #ceph
[17:42] * sudocat (~dibarra@192.185.1.20) has joined #ceph
[17:42] * yguang11 (~yguang11@nat-dip30-wl-d.cfw-a-gci.corp.yahoo.com) has joined #ceph
[17:46] * fghaas (~florian@91-119-120-46.dynamic.xdsl-line.inode.at) has joined #ceph
[17:46] * ade (~abradshaw@217.192.191.82) has joined #ceph
[17:48] * dyasny_ (~dyasny@dsl.dynamic.190-116-74-123.electronicbox.net) Quit (Ping timeout: 480 seconds)
[17:48] * DV__ (~veillard@2001:41d0:a:f29f::1) has joined #ceph
[17:50] * mykola (~Mikolaj@91.225.200.174) Quit (Ping timeout: 480 seconds)
[17:55] * DV (~veillard@2001:41d0:a:f29f::1) Quit (Ping timeout: 480 seconds)
[17:56] * mykola (~Mikolaj@91.225.200.122) has joined #ceph
[17:57] * thomnico (~thomnico@2a01:e35:8b41:120:3c78:b6d0:99ff:469d) has joined #ceph
[17:57] * enax (~enax@hq.ezit.hu) Quit (Ping timeout: 480 seconds)
[18:00] * dgurtner (~dgurtner@178.197.235.80) has joined #ceph
[18:00] * jordan__ (~jordan@204.13-14-84.ripe.coltfrance.com) Quit (Read error: Connection reset by peer)
[18:01] * jordanP (~jordan@204.13-14-84.ripe.coltfrance.com) has joined #ceph
[18:01] * steveeJ (~junky@HSI-KBW-149-172-252-139.hsi13.kabel-badenwuerttemberg.de) Quit (Quit: Leaving)
[18:07] * haomaiwang (~haomaiwan@li745-113.members.linode.com) has joined #ceph
[18:09] * dyasny (~dyasny@cable-192.222.131.135.electronicbox.net) has joined #ceph
[18:15] * haomaiwang (~haomaiwan@li745-113.members.linode.com) Quit (Ping timeout: 480 seconds)
[18:17] * thomnico (~thomnico@2a01:e35:8b41:120:3c78:b6d0:99ff:469d) Quit (Quit: Ex-Chat)
[18:21] * vasu (~vasu@c-73-231-60-138.hsd1.ca.comcast.net) has joined #ceph
[18:23] * steveeJ (~junky@HSI-KBW-149-172-252-139.hsi13.kabel-badenwuerttemberg.de) has joined #ceph
[18:23] * rdleblanc (~rdleblanc@69-195-66-42.unifiedlayer.com) has joined #ceph
[18:23] * TMM (~hp@178-84-46-106.dynamic.upc.nl) has joined #ceph
[18:23] * Discovery (~Discovery@178.239.49.71) has joined #ceph
[18:24] * shylesh (~shylesh@59.95.69.124) has joined #ceph
[18:27] * jordanP (~jordan@204.13-14-84.ripe.coltfrance.com) Quit (Quit: Leaving)
[18:27] * dugravot6 (~dugravot6@dn-infra-04.lionnois.univ-lorraine.fr) Quit (Quit: Leaving.)
[18:29] * liviudm (~liviudm@95.76.178.136) Quit (Quit: Textual IRC Client: www.textualapp.com)
[18:33] * olid19815 (~olid1982@aftr-185-17-206-208.dynamic.mnet-online.de) Quit (Read error: Connection reset by peer)
[18:34] * olid19816 (~olid1982@aftr-185-17-206-208.dynamic.mnet-online.de) has joined #ceph
[18:36] * thomnico (~thomnico@2a01:e35:8b41:120:3c78:b6d0:99ff:469d) has joined #ceph
[18:36] * bvi (~bastiaan@185.56.32.1) Quit (Quit: Ex-Chat)
[18:36] * thomnico (~thomnico@2a01:e35:8b41:120:3c78:b6d0:99ff:469d) Quit ()
[18:36] * Be-El (~quassel@fb08-bcf-pc01.computational.bio.uni-giessen.de) Quit (Remote host closed the connection)
[18:37] <LobsterRoll> TheSov: what do you mean a size 1, you mean replication size?
[18:40] * wjw-freebsd (~wjw@vpn.ecoracks.nl) Quit (Ping timeout: 480 seconds)
[18:42] * olid19816 (~olid1982@aftr-185-17-206-208.dynamic.mnet-online.de) Quit (Read error: No route to host)
[18:42] * olid19816 (~olid1982@aftr-185-17-206-208.dynamic.mnet-online.de) has joined #ceph
[18:44] * dougf (~dougf@96-38-99-179.dhcp.jcsn.tn.charter.com) Quit (Ping timeout: 480 seconds)
[18:44] * rotbeard (~redbeard@185.32.80.238) Quit (Quit: Leaving)
[18:45] * dougf (~dougf@96-38-99-179.dhcp.jcsn.tn.charter.com) has joined #ceph
[18:46] * i_m (~ivan.miro@88.206.113.199) has joined #ceph
[18:49] * cathode (~cathode@50-198-166-81-static.hfc.comcastbusiness.net) Quit (Quit: Leaving)
[18:52] * harold (~hamiller@71-94-227-123.dhcp.mdfd.or.charter.com) has joined #ceph
[18:53] * harold (~hamiller@71-94-227-123.dhcp.mdfd.or.charter.com) Quit ()
[18:54] * neurodrone (~neurodron@108.60.145.130) Quit (Read error: Connection reset by peer)
[18:54] * neurodrone (~neurodron@108.60.145.130) has joined #ceph
[18:59] * dgurtner (~dgurtner@178.197.235.80) Quit (Read error: Connection reset by peer)
[19:09] * krypto (~krypto@G68-121-13-42.sbcis.sbc.com) Quit (Read error: Connection reset by peer)
[19:14] * kefu (~kefu@114.92.107.250) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[19:19] * blo (~bloriot@LFbn-1-635-165.w86-246.abo.wanadoo.fr) Quit (Quit: Quitte)
[19:19] * pabluk is now known as pabluk_
[19:21] * bara (~bara@nat-pool-brq-t.redhat.com) Quit (Ping timeout: 480 seconds)
[19:24] * johnavp1989 (~jpetrini@8.39.115.8) has joined #ceph
[19:25] * reed (~reed@216.38.134.18) has joined #ceph
[19:27] * jrankin (~jrankin@d53-64-170-236.nap.wideopenwest.com) Quit (Quit: Leaving)
[19:29] * ChrisNBlum (~ChrisNBlu@storchris.dorf.rwth-aachen.de) Quit (Quit: ZNC - http://znc.in)
[19:51] * ChrisNBlum (~ChrisNBlu@storchris.dorf.rwth-aachen.de) has joined #ceph
[19:51] * cathode (~cathode@50-198-166-81-static.hfc.comcastbusiness.net) has joined #ceph
[20:01] * jordanP (~jordan@bdv75-2-81-57-250-57.fbx.proxad.net) has joined #ceph
[20:06] * rogierm (~rogierm@095-097-129-154.static.chello.nl) Quit (Remote host closed the connection)
[20:20] * fleshy (~oftc-webi@fia138-2-100.dsl.mxposure.nl) has joined #ceph
[20:20] * TMM (~hp@178-84-46-106.dynamic.upc.nl) Quit (Read error: Connection reset by peer)
[20:21] * LobsterRoll (~LobsterRo@140.247.242.44) Quit (Quit: LobsterRoll)
[20:27] <fleshy> Hi. Having a look at the manual I understand that when a OSD crashes, their OSD fellows in the PG will warn a monitor about the crash. A monitor needs at least 3 messages warning about the crash to actually set that OSD as down on the cluster map.
[20:31] <fleshy> I couldn't igure out what's the elapse time between the messages an OSD sends a monitor informing about the crash. Is it a whole grace period? Thus, an a OSD will take 3xgrace period (20s bydefault) to be marked as down??
[20:34] * shylesh (~shylesh@59.95.69.124) Quit (Remote host closed the connection)
[20:35] <fghaas> it's 3 downs from 3 different peer OSDs, which typically come in almost simultaneously
[20:38] * ade (~abradshaw@217.192.191.82) Quit (Quit: Too sexy for his shirt)
[20:39] <fleshy> by default only oneOSD is required I read http://docs.ceph.com/docs/master/rados/configuration/mon-osd-interaction/#osds-report-down-osds
[20:39] * bara (~bara@ip4-83-240-10-82.cust.nbox.cz) has joined #ceph
[20:39] * bara (~bara@ip4-83-240-10-82.cust.nbox.cz) Quit ()
[20:39] <fleshy> but I understand you are right fghaas an probably different OSD will warn almost simultaneously
[20:40] <fghaas> I may be mis-remembering and it's been a long day, so take my words with a pinch of salt
[20:40] <fleshy> and that should be enough
[20:40] <fleshy> hehe no problem
[20:42] * jordanP (~jordan@bdv75-2-81-57-250-57.fbx.proxad.net) Quit (Ping timeout: 480 seconds)
[20:44] * lpabon (~lpabon@24-151-54-34.dhcp.nwtn.ct.charter.com) has joined #ceph
[20:44] * lpabon (~lpabon@24-151-54-34.dhcp.nwtn.ct.charter.com) Quit ()
[20:44] * jclm1 (~jclm@155.94.171.151) Quit (Quit: Leaving.)
[20:44] * lpabon (~lpabon@24-151-54-34.dhcp.nwtn.ct.charter.com) has joined #ceph
[20:50] * wjw-freebsd (~wjw@smtp.digiware.nl) has joined #ceph
[21:12] * LobsterRoll (~LobsterRo@140.247.242.44) has joined #ceph
[21:13] <snakamoto> fleshy: default is only 1 OSD needs to report someone as being down
[21:13] <snakamoto> also, that 1 OSD needs to make 3 consecutive reports
[21:13] <snakamoto> then the monitor will believe that the reported OSD is down
[21:14] <snakamoto> after that, if the OSD is down for 5 minutes, it will be marked as out, and backfill will begin
[21:15] <snakamoto> you can get a lot of these values by looking at command ceph daemon mon.<daemon name> config show
[21:19] * lpabon (~lpabon@24-151-54-34.dhcp.nwtn.ct.charter.com) Quit (Remote host closed the connection)
[21:20] <LobsterRoll> can one ceph client be a client of multiple ceph clusters?
[21:27] * dgurtner (~dgurtner@178.197.235.80) has joined #ceph
[21:27] * linuxkidd (~linuxkidd@49.sub-70-209-96.myvzw.com) Quit (Ping timeout: 480 seconds)
[21:28] * linuxkidd (~linuxkidd@49.sub-70-209-96.myvzw.com) has joined #ceph
[21:43] <lae_> what happened to the ceph-users ml archive? why are so many threads in 2015 missing?
[21:43] * lae_ is now known as lae
[21:43] * Zombiekiller (~Roy@179.43.148.66) has joined #ceph
[21:44] * lpabon (~lpabon@24-151-54-34.dhcp.nwtn.ct.charter.com) has joined #ceph
[21:44] * mykola (~Mikolaj@91.225.200.122) Quit (Quit: away)
[21:46] <fleshy> :snakamoto that's of great help!
[21:47] <fleshy> snakamoto: do you know how long does a OSD wait between consecutive reports?
[21:47] <fleshy> Initially I believe it waits a grace period of 20 seconds. But how long would it wait for the second report? Another grace period?
[21:48] <fleshy> or do you know through which command I can get that info?
[21:56] * haomaiwang (~haomaiwan@li745-113.members.linode.com) has joined #ceph
[22:01] * haomaiwang (~haomaiwan@li745-113.members.linode.com) Quit (Remote host closed the connection)
[22:03] * rendar (~I@host134-192-dynamic.181-80-r.retail.telecomitalia.it) Quit (Ping timeout: 480 seconds)
[22:06] * rendar (~I@host134-192-dynamic.181-80-r.retail.telecomitalia.it) has joined #ceph
[22:07] * LobsterRoll (~LobsterRo@140.247.242.44) Quit (Ping timeout: 480 seconds)
[22:10] <georgem> anybody running encrypted OSDs? any major performance impact observed?
[22:12] <lurbs> Yes, and no. Although we're using a non-default set of algorithms.
[22:13] * Zombiekiller (~Roy@4MJAAA2CW.tor-irc.dnsbl.oftc.net) Quit ()
[22:13] <neurodrone> What???s encrypted OSDs?
[22:13] * fghaas (~florian@91-119-120-46.dynamic.xdsl-line.inode.at) has left #ceph
[22:13] <lurbs> And had to make sure that AES acceleration was correctly enabled. A non-accelerating kernel module (xts) was blacklisted, so aes_intel was used.
[22:14] * enax (~enax@94-21-125-233.pool.digikabel.hu) has joined #ceph
[22:14] <cathode> hey just curious is anyone using systems with SAS expanders for ceph?
[22:14] <lurbs> I believe that the patches to allow for choosing algorithms got pushed from here to upstream and made it into Hammer.
[22:15] <cathode> i'd like to know if the expander has any significant impact on performance
[22:15] <lurbs> Also using LUKS, not plain.
[22:17] <georgem> lurbs: thanks
[22:22] <lurbs> Across 4K, 128K and 4M IO rados bench tests we averaged ~2.5% slower, after tweaking. That was with Giant (with in house patches, now upstream in Hammer).
[22:26] * georgem (~Adium@206.108.127.16) Quit (Ping timeout: 480 seconds)
[22:29] <lurbs> Full disclaimer: That tweaking was not entirely just related to encryption, so the true difference is probably higher. I don't have the pure encryption numbers unfortunately due to time contraints.
[22:31] <lookcrabs> lurbs: do you have any papers or documentations or links about any of your encryption tests? Like a blog post or anything from your company? Just curious.
[22:33] <Rachana> hi, whats the path for PG log
[22:35] <snakamoto> fleshy: osd_heartbeat_interval is the setting, default is 6 seconds
[22:36] * dgurtner (~dgurtner@178.197.235.80) Quit (Ping timeout: 480 seconds)
[22:38] <snakamoto> cathode: we're using the built-in expanders on an R730xd's backplane
[22:39] <snakamoto> we haven't found it to be a bottleneck as far as throughput goes for 14x SATA
[22:39] * TMM (~hp@178-84-46-106.dynamic.upc.nl) has joined #ceph
[22:40] <snakamoto> I believe we tested 26x SATA and were able to get full-rate for the 2.5" 7200k RPM drives
[22:40] <snakamoto> I can't speak towards latency though =(
[22:40] <T1> sas/sata expanders are not bottlenecks in any way
[22:40] * garphy is now known as garphy`aw
[22:41] * LobsterRoll (~LobsterRo@65.112.8.129) has joined #ceph
[22:50] * georgem (~Adium@184.151.179.251) has joined #ceph
[22:52] * enax (~enax@94-21-125-233.pool.digikabel.hu) Quit (Ping timeout: 480 seconds)
[22:59] * LobsterRoll (~LobsterRo@65.112.8.129) Quit (Quit: LobsterRoll)
[23:04] * mtb` (~mtb`@157.130.171.46) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[23:06] * thansen (~thansen@17.253.sfcn.org) has joined #ceph
[23:07] * DV__ (~veillard@2001:41d0:a:f29f::1) Quit (Remote host closed the connection)
[23:07] * DV (~veillard@2001:41d0:a:f29f::1) has joined #ceph
[23:07] * angdraug (~angdraug@64.124.158.100) has joined #ceph
[23:07] * lxo (~aoliva@lxo.user.oftc.net) has joined #ceph
[23:10] * lx0 (~aoliva@lxo.user.oftc.net) Quit (Read error: Connection reset by peer)
[23:12] * Nijikokun (~visored@4MJAAA2FU.tor-irc.dnsbl.oftc.net) has joined #ceph
[23:12] * derjohn_mob (~aj@fw.gkh-setu.de) Quit (Ping timeout: 480 seconds)
[23:13] * danieagle (~Daniel@179.111.172.42) Quit (Quit: Obrigado por Tudo! :-) inte+ :-))
[23:13] * linjan_ (~linjan@176.195.148.67) Quit (Ping timeout: 480 seconds)
[23:14] <cathode> snakamoto - ok thanks
[23:14] <cathode> another guy cautioned me against expanders because of latency concerns
[23:19] * garphy`aw is now known as garphy
[23:23] * fleshy (~oftc-webi@fia138-2-100.dsl.mxposure.nl) Quit (Quit: Page closed)
[23:23] * dlan (~dennis@116.228.88.131) Quit (Remote host closed the connection)
[23:27] * LDA (~DM@host217-114-156-249.pppoe.mark-itt.net) Quit (Quit: Nettalk6 - www.ntalk.de)
[23:30] * Discovery (~Discovery@178.239.49.71) Quit (Read error: Connection reset by peer)
[23:31] * mhack|afk (~mhack@nat-pool-bos-t.redhat.com) Quit (Remote host closed the connection)
[23:31] * dlan (~dennis@116.228.88.131) has joined #ceph
[23:34] * efirs (~firs@c-73-231-190-117.hsd1.ca.comcast.net) has joined #ceph
[23:34] * georgem (~Adium@184.151.179.251) Quit (Quit: Leaving.)
[23:34] * brad_mssw (~brad@66.129.88.50) Quit (Quit: Leaving)
[23:34] * thansen (~thansen@17.253.sfcn.org) Quit (Quit: Ex-Chat)
[23:34] * lpabon (~lpabon@24-151-54-34.dhcp.nwtn.ct.charter.com) Quit (Ping timeout: 480 seconds)
[23:41] * mattbenjamin (~mbenjamin@aa2.linuxbox.com) Quit (Quit: Leaving.)
[23:42] * Nijikokun (~visored@4MJAAA2FU.tor-irc.dnsbl.oftc.net) Quit ()
[23:45] * kamalmarhubi (sid26581@2604:8300:100:200b:6667:4:0:67d5) has left #ceph
[23:47] * ibravo (~ibravo@72.83.69.64) Quit (Quit: This computer has gone to sleep)
[23:51] * johnavp1989 (~jpetrini@8.39.115.8) Quit (Ping timeout: 480 seconds)
[23:59] <snakamoto> cathode: it's true that an expander has to introduce some kind of latency, but I can't find any data from LSI

These logs were automatically created by CephLogBot on irc.oftc.net using the Java IRC LogBot.