#ceph IRC Log

Index

IRC Log for 2015-07-23

Timestamps are in GMT/BST.

[0:00] * Ceph-Log-Bot (~logstash@185.66.248.215) has joined #ceph
[0:00] * Ceph-Log-Bot (~logstash@185.66.248.215) Quit (Read error: Connection reset by peer)
[0:03] <snakamoto> incephtion
[0:05] * jbautista- (~wushudoin@transit-86-181-132-209.redhat.com) has joined #ceph
[0:07] * sjm (~sjm@pool-100-1-115-73.nwrknj.fios.verizon.net) has left #ceph
[0:12] * wushudoin_ (~wushudoin@38.140.108.2) Quit (Ping timeout: 480 seconds)
[0:13] * jbautista- (~wushudoin@transit-86-181-132-209.redhat.com) Quit (Ping timeout: 480 seconds)
[0:13] * jbautista- (~wushudoin@38.140.108.2) has joined #ceph
[0:17] * Concubidated (~Adium@161.225.196.30) Quit (Quit: Leaving.)
[0:18] <snakamoto> doppelgrau: this wasn't the most interesting topic to me at the moment, so my notes are not that great
[0:19] <snakamoto> The OSD map is used to calculate data placement. As OSDs leave and enter the cluster, and the monitors tune data placement, these maps change
[0:20] <snakamoto> When OSDs need to replicate, or when clients need to access the cluster, they need to make sure they have the most current map version.
[0:20] <snakamoto> If they don't have the most current version, then will request an update.
[0:20] <snakamoto> Now, if you have a tiny cluster, sending the entire map is no big deal, but imagine if you have thousands and thousands of OSDs in your map.
[0:21] * fridim_ (~fridim@56-198-190-109.dsl.ovh.fr) Quit (Ping timeout: 480 seconds)
[0:21] <doppelgrau> snakamoto: so the ???history??? is used to be able to send ???diffs"
[0:21] <snakamoto> Ceph has the ability to calculate and send just the differential between your outdated map, and the current map.
[0:21] <snakamoto> that's what it sounds like
[0:25] * yghannam (~yghannam@0001f8aa.user.oftc.net) Quit (Quit: Leaving)
[0:25] * Karcaw (~evan@71-95-122-38.dhcp.mdfd.or.charter.com) Quit (Ping timeout: 480 seconds)
[0:26] <snakamoto> "wasn't the most interesting topic" == total weasel words for "wasn't paying attention"
[0:27] <doppelgrau> ok, that makes sense.
[0:27] <doppelgrau> ;)
[0:27] <snakamoto> =D
[0:33] * gucki (~smuxi@office.netskin.com) Quit (Ping timeout: 480 seconds)
[0:34] * Karcaw (~evan@71-95-122-38.dhcp.mdfd.or.charter.com) has joined #ceph
[0:35] * yghannam (~yghannam@0001f8aa.user.oftc.net) has joined #ceph
[0:36] * Sysadmin88 (~IceChat77@05453139.skybroadband.com) has joined #ceph
[0:42] * wicope (~wicope@0001fd8a.user.oftc.net) Quit (Remote host closed the connection)
[0:42] * yanzheng (~zhyan@182.139.21.196) has joined #ceph
[0:43] <loicd> Anticimex: nice
[0:43] * kmARC (~kmARC@84-73-73-158.dclient.hispeed.ch) Quit (Ping timeout: 480 seconds)
[0:52] * dmick (~dmick@206.169.83.146) has joined #ceph
[0:53] * yanzheng (~zhyan@182.139.21.196) Quit (Quit: This computer has gone to sleep)
[0:54] * rlrevell (~leer@184.52.129.221) has joined #ceph
[0:55] * yanzheng (~zhyan@182.139.21.196) has joined #ceph
[0:56] * dgurtner (~dgurtner@217-162-119-191.dynamic.hispeed.ch) Quit (Ping timeout: 480 seconds)
[0:59] * TheSov (~TheSov@204.13.200.248) Quit (Quit: Leaving)
[1:02] * yanzheng (~zhyan@182.139.21.196) Quit (Quit: This computer has gone to sleep)
[1:09] * rendar (~I@host147-5-dynamic.55-79-r.retail.telecomitalia.it) Quit ()
[1:16] * oms101 (~oms101@p20030057EA0A5900EEF4BBFFFE0F7062.dip0.t-ipconnect.de) Quit (Ping timeout: 480 seconds)
[1:24] * oms101 (~oms101@p20030057EA5AC500EEF4BBFFFE0F7062.dip0.t-ipconnect.de) has joined #ceph
[1:24] * rlrevell (~leer@184.52.129.221) Quit (Read error: Connection reset by peer)
[1:25] * i_m (~ivan.miro@83.149.37.176) Quit (Ping timeout: 480 seconds)
[1:26] * ircolle (~Adium@2601:285:201:2bf9:1cae:844d:bff8:d8ad) Quit (Quit: Leaving.)
[1:29] * stiopa (~stiopa@cpc73828-dals21-2-0-cust630.20-2.cable.virginm.net) Quit (Ping timeout: 480 seconds)
[1:40] * alram (~alram@cpe-172-250-2-46.socal.res.rr.com) Quit (Ping timeout: 480 seconds)
[1:44] * rlrevell (~leer@184.52.129.221) has joined #ceph
[1:44] * reinhardt1053 (~reinhardt@185.40.62.209) has joined #ceph
[1:47] * xarses_ (~xarses@173-164-194-206-SFBA.hfc.comcastbusiness.net) has joined #ceph
[2:00] * reinhardt1053 (~reinhardt@185.40.62.209) Quit (Remote host closed the connection)
[2:06] * xarses_ (~xarses@173-164-194-206-SFBA.hfc.comcastbusiness.net) Quit (Remote host closed the connection)
[2:09] * xarses_ (~xarses@173-164-194-206-SFBA.hfc.comcastbusiness.net) has joined #ceph
[2:10] * moore (~moore@64.202.160.88) Quit (Remote host closed the connection)
[2:17] * bitserker (~toni@188.87.126.67) has joined #ceph
[2:20] * yguang11 (~yguang11@2001:4998:effd:600:d5e1:b385:729e:daa8) Quit (Remote host closed the connection)
[2:26] * arbrandes (~arbrandes@179.210.13.90) Quit (Quit: Leaving)
[2:34] * doppelgrau (~doppelgra@pd956d116.dip0.t-ipconnect.de) Quit (Quit: doppelgrau)
[2:34] <snakamoto> Anybody have experience with 'osd backfill full ratio ' ?
[2:37] * dmick (~dmick@206.169.83.146) has left #ceph
[3:02] * elt (~MKoR@89.248.172.103) has joined #ceph
[3:03] * xarses_ (~xarses@173-164-194-206-SFBA.hfc.comcastbusiness.net) Quit (Ping timeout: 480 seconds)
[3:07] * fam_away is now known as fam
[3:08] * angdraug (~angdraug@12.164.168.117) Quit (Ping timeout: 480 seconds)
[3:12] * haomaiwang (~haomaiwan@li1072-91.members.linode.com) Quit (Remote host closed the connection)
[3:14] * ira (~ira@c-71-233-225-22.hsd1.ma.comcast.net) Quit (Quit: Leaving)
[3:23] * zhaochao (~zhaochao@111.161.77.231) has joined #ceph
[3:24] * rlrevell (~leer@184.52.129.221) Quit (Read error: Connection reset by peer)
[3:24] <snakamoto> I don't think it works the way I think it works
[3:27] * bitserker (~toni@188.87.126.67) Quit (Quit: Leaving.)
[3:32] * elt (~MKoR@89.248.172.103) Quit ()
[3:33] * cholcombe (~chris@c-73-180-29-35.hsd1.or.comcast.net) Quit (Ping timeout: 480 seconds)
[3:33] * yanzheng (~zhyan@182.139.21.196) has joined #ceph
[3:34] * xarses_ (~xarses@c-73-202-191-48.hsd1.ca.comcast.net) has joined #ceph
[3:37] * shyu (~Shanzhi@119.254.120.66) has joined #ceph
[3:41] * andreww (~xarses@208.78.244.200) has joined #ceph
[3:48] * OutOfNoWhere (~rpb@199.68.195.101) has joined #ceph
[3:48] * xarses_ (~xarses@c-73-202-191-48.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[3:49] * nsoffer (~nsoffer@bzq-109-65-255-114.red.bezeqint.net) Quit (Ping timeout: 480 seconds)
[3:50] * carlo (~mod@78.9.110.81) has joined #ceph
[3:53] * carlo (~mod@78.9.110.81) Quit (Quit: Wychodzi)
[3:58] * nsoffer (~nsoffer@bzq-79-177-255-219.red.bezeqint.net) has joined #ceph
[3:58] * kefu (~kefu@114.86.210.64) has joined #ceph
[4:02] * nsoffer (~nsoffer@bzq-79-177-255-219.red.bezeqint.net) Quit (Read error: Connection reset by peer)
[4:03] * nsoffer (~nsoffer@bzq-79-177-255-219.red.bezeqint.net) has joined #ceph
[4:04] * smerz (~ircircirc@37.74.194.90) Quit (Ping timeout: 480 seconds)
[4:06] * rlrevell (~leer@184.52.129.221) has joined #ceph
[4:07] * nsoffer (~nsoffer@bzq-79-177-255-219.red.bezeqint.net) Quit (Read error: Connection reset by peer)
[4:07] * kefu (~kefu@114.86.210.64) Quit (Max SendQ exceeded)
[4:08] * kefu (~kefu@114.86.210.64) has joined #ceph
[4:22] * yguang11 (~yguang11@c-50-131-146-113.hsd1.ca.comcast.net) has joined #ceph
[4:23] * nsoffer (~nsoffer@bzq-79-177-255-219.red.bezeqint.net) has joined #ceph
[4:27] * yguang11_ (~yguang11@2001:4998:effd:7804::1032) has joined #ceph
[4:28] <ndru> Hello all, working with glance on ceph. It seems if I create a volume from an image which differs in size from the image, it still downloads it to the host and converts it, then imports it. Is there a way to prevent this from happening?
[4:28] * Ceph-Log-Bot (~logstash@185.66.248.215) has joined #ceph
[4:28] * Ceph-Log-Bot (~logstash@185.66.248.215) Quit (Read error: Connection reset by peer)
[4:34] * yguang11 (~yguang11@c-50-131-146-113.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[4:44] * shang (~ShangWu@175.41.48.77) has joined #ceph
[4:47] * tuanlq5 (~tuanlq@proxy.hcm.fpt.vn) Quit (Remote host closed the connection)
[4:49] * jks (~jks@178.155.151.121) Quit (Ping timeout: 480 seconds)
[4:51] * nsoffer (~nsoffer@bzq-79-177-255-219.red.bezeqint.net) Quit (Ping timeout: 480 seconds)
[5:06] * terje_ (~root@135.109.216.239) has joined #ceph
[5:08] * terje (~root@135.109.216.239) Quit (Ping timeout: 480 seconds)
[5:09] * capri_on (~capri@212.218.127.222) has joined #ceph
[5:11] * calvinx (~calvin@101.100.172.246) Quit (Quit: calvinx)
[5:13] * capri (~capri@212.218.127.222) Quit (Ping timeout: 480 seconds)
[5:13] * calvinx (~calvin@101.100.172.246) has joined #ceph
[5:25] * yguang11_ (~yguang11@2001:4998:effd:7804::1032) Quit (Ping timeout: 480 seconds)
[5:27] * shyu (~Shanzhi@119.254.120.66) Quit (Ping timeout: 480 seconds)
[5:27] * Vacuum__ (~Vacuum@i59F79F78.versanet.de) has joined #ceph
[5:31] * shyu (~Shanzhi@119.254.120.66) has joined #ceph
[5:32] * jluis (~joao@249.38.136.95.rev.vodafone.pt) has joined #ceph
[5:32] * ChanServ sets mode +o jluis
[5:34] * Vacuum_ (~Vacuum@88.130.223.16) Quit (Ping timeout: 480 seconds)
[5:37] * joao (~joao@249.38.136.95.rev.vodafone.pt) Quit (Ping timeout: 480 seconds)
[5:42] * terje (~root@135.109.216.239) has joined #ceph
[5:43] * terje_ (~root@135.109.216.239) Quit (Ping timeout: 480 seconds)
[5:48] * terje_ (~root@135.109.216.239) has joined #ceph
[5:50] * terje (~root@135.109.216.239) Quit (Ping timeout: 480 seconds)
[5:51] * xarses_ (~xarses@c-73-202-191-48.hsd1.ca.comcast.net) has joined #ceph
[5:58] * andreww (~xarses@208.78.244.200) Quit (Ping timeout: 480 seconds)
[5:58] * terje_ (~root@135.109.216.239) Quit (Ping timeout: 480 seconds)
[5:58] * cooldharma06 (~chatzilla@14.139.180.40) Quit (Quit: ChatZilla 0.9.91.1 [Iceweasel 21.0/20130515140136])
[5:59] * terje (~root@135.109.216.239) has joined #ceph
[6:02] * rlrevell (~leer@184.52.129.221) has left #ceph
[6:04] * Concubidated (~Adium@66-87-145-219.pools.spcsdns.net) has joined #ceph
[6:07] * terje (~root@135.109.216.239) Quit (Ping timeout: 480 seconds)
[6:12] * yguang11 (~yguang11@2001:4998:effd:7804::1032) has joined #ceph
[6:15] * kefu (~kefu@114.86.210.64) Quit (Max SendQ exceeded)
[6:16] * kefu (~kefu@114.86.210.64) has joined #ceph
[6:21] * terje (~root@135.109.216.239) has joined #ceph
[6:27] * yghannam (~yghannam@0001f8aa.user.oftc.net) Quit (Ping timeout: 480 seconds)
[6:27] * kanagaraj (~kanagaraj@121.244.87.117) has joined #ceph
[6:48] * kefu (~kefu@114.86.210.64) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[6:48] * lucas1 (~Thunderbi@218.76.52.64) Quit (Read error: Connection reset by peer)
[6:54] * vbellur (~vijay@122.171.200.74) Quit (Ping timeout: 480 seconds)
[7:00] * lucas1 (~Thunderbi@218.76.52.64) has joined #ceph
[7:01] * yguang11 (~yguang11@2001:4998:effd:7804::1032) Quit (Ping timeout: 480 seconds)
[7:02] * Ceph-Log-Bot (~logstash@185.66.248.215) has joined #ceph
[7:02] * Ceph-Log-Bot (~logstash@185.66.248.215) Quit (Read error: Connection reset by peer)
[7:03] * yguang11 (~yguang11@nat-dip15.fw.corp.yahoo.com) has joined #ceph
[7:03] * zaitcev (~zaitcev@c-76-113-49-212.hsd1.nm.comcast.net) Quit (Quit: Bye)
[7:05] * terje_ (~root@135.109.216.239) has joined #ceph
[7:07] * terje (~root@135.109.216.239) Quit (Ping timeout: 480 seconds)
[7:11] * calvinx (~calvin@101.100.172.246) Quit (Quit: calvinx)
[7:11] * snakamoto (~Adium@192.16.26.2) Quit (Quit: Leaving.)
[7:12] * kmARC (~kmARC@84-73-73-158.dclient.hispeed.ch) has joined #ceph
[7:15] * bkopilov (~bkopilov@bzq-79-180-127-78.red.bezeqint.net) Quit (Ping timeout: 480 seconds)
[7:16] * bkopilov (~bkopilov@bzq-79-181-179-109.red.bezeqint.net) has joined #ceph
[7:16] * Sriman (~oftc-webi@202.65.140.146) has joined #ceph
[7:16] * tobiash_ (~quassel@mail.bmw-carit.de) Quit (Remote host closed the connection)
[7:17] <Sriman> HI , I need a help on Teuthology
[7:17] <Sriman> Can u guys help me??
[7:17] * wschulze (~wschulze@cpe-69-206-240-164.nyc.res.rr.com) Quit (Quit: Leaving.)
[7:21] * jluis (~joao@249.38.136.95.rev.vodafone.pt) Quit (Ping timeout: 480 seconds)
[7:21] * jluis (~joao@249.38.136.95.rev.vodafone.pt) has joined #ceph
[7:21] * ChanServ sets mode +o jluis
[7:22] * linjan (~linjan@176.195.217.90) has joined #ceph
[7:22] <Sriman> failure_reason: 'Stale jobs detected, aborting. this is the error message while running teuthology
[7:23] <Sriman> can anyone tell me what might be the reason
[7:23] <Sriman> ?
[7:26] * vbellur (~vijay@121.244.87.124) has joined #ceph
[7:27] * Sriman (~oftc-webi@202.65.140.146) Quit (Quit: Page closed)
[7:35] * rdas (~rdas@121.244.87.116) has joined #ceph
[7:40] * linjan (~linjan@176.195.217.90) Quit (Ping timeout: 480 seconds)
[7:45] * yguang11 (~yguang11@nat-dip15.fw.corp.yahoo.com) Quit (Remote host closed the connection)
[7:45] * yguang11 (~yguang11@2001:4998:effd:7804::1032) has joined #ceph
[7:46] * terje_ (~root@135.109.216.239) Quit (Ping timeout: 480 seconds)
[7:50] * kmARC (~kmARC@84-73-73-158.dclient.hispeed.ch) Quit (Ping timeout: 480 seconds)
[7:50] * overclk (~overclk@121.244.87.117) has joined #ceph
[7:50] * rotbeard (~redbeard@2a02:908:df10:d300:76f0:6dff:fe3b:994d) Quit (Quit: Verlassend)
[7:50] * terje (~root@135.109.216.239) has joined #ceph
[7:51] * shylesh__ (~shylesh@121.244.87.124) has joined #ceph
[7:58] * linjan (~linjan@176.195.217.90) has joined #ceph
[8:08] * terje_ (~root@135.109.216.239) has joined #ceph
[8:10] * kefu (~kefu@114.86.210.64) has joined #ceph
[8:10] * terje (~root@135.109.216.239) Quit (Ping timeout: 480 seconds)
[8:11] * dopesong (~dopesong@88-119-94-55.static.zebra.lt) has joined #ceph
[8:13] * dopesong_ (~dopesong@lb1.mailer.data.lt) has joined #ceph
[8:14] * linjan (~linjan@176.195.217.90) Quit (Ping timeout: 480 seconds)
[8:15] * Miouge (~Miouge@91.178.33.59) has joined #ceph
[8:16] * terje (~root@135.109.216.239) has joined #ceph
[8:19] * dopesong (~dopesong@88-119-94-55.static.zebra.lt) Quit (Ping timeout: 480 seconds)
[8:19] * terje_ (~root@135.109.216.239) Quit (Ping timeout: 480 seconds)
[8:24] * terje (~root@135.109.216.239) Quit (Ping timeout: 480 seconds)
[8:25] * yguang11 (~yguang11@2001:4998:effd:7804::1032) Quit (Ping timeout: 480 seconds)
[8:27] * terje (~root@135.109.216.239) has joined #ceph
[8:31] * calvinx (~calvin@101.100.172.246) has joined #ceph
[8:34] * terje_ (~root@135.109.216.239) has joined #ceph
[8:36] * terje (~root@135.109.216.239) Quit (Ping timeout: 480 seconds)
[8:36] * theambient (~theambien@178.162.35.192) Quit (Quit: Leaving...)
[8:45] * terje (~root@135.109.216.239) has joined #ceph
[8:46] * i_m (~ivan.miro@83.149.35.66) has joined #ceph
[8:47] * terje_ (~root@135.109.216.239) Quit (Ping timeout: 480 seconds)
[8:48] * fridim_ (~fridim@56-198-190-109.dsl.ovh.fr) has joined #ceph
[8:50] * rotbeard (~redbeard@2a02:908:df10:d300:6267:20ff:feb7:c20) has joined #ceph
[8:51] * terje_ (~root@135.109.216.239) has joined #ceph
[8:53] * shohn (~shohn@164.139.7.150) has joined #ceph
[8:53] * terje (~root@135.109.216.239) Quit (Ping timeout: 480 seconds)
[8:55] * OutOfNoWhere (~rpb@199.68.195.101) Quit (Ping timeout: 480 seconds)
[8:58] * maxxware (~maxx@149.210.133.105) Quit (Quit: leaving)
[8:59] * adrian (~abradshaw@130.117.88.81) has joined #ceph
[8:59] * terje (~root@135.109.216.239) has joined #ceph
[9:00] * adrian is now known as Guest1104
[9:01] * terje_ (~root@135.109.216.239) Quit (Ping timeout: 480 seconds)
[9:05] * terje_ (~root@135.109.216.239) has joined #ceph
[9:06] * terje (~root@135.109.216.239) Quit (Read error: No route to host)
[9:08] * Guest1104 (~abradshaw@130.117.88.81) Quit (Ping timeout: 480 seconds)
[9:08] * Nacer (~Nacer@203-206-190-109.dsl.ovh.fr) Quit (Remote host closed the connection)
[9:10] * SinZ|offline (~Qiasfah@tor-exit-node.7by7.de) has joined #ceph
[9:11] * smerz (~ircircirc@ip-213-127-160-90.ip.prioritytelecom.net) has joined #ceph
[9:14] * terje (~root@135.109.216.239) has joined #ceph
[9:15] * terje_ (~root@135.109.216.239) Quit (Ping timeout: 480 seconds)
[9:15] * sleinen (~Adium@2001:620:0:2d:7ed1:c3ff:fedc:3223) has joined #ceph
[9:16] * kawa2014 (~kawa@89.184.114.246) has joined #ceph
[9:17] * gucki (~smuxi@office.netskin.com) has joined #ceph
[9:18] * dgurtner (~dgurtner@178.197.231.188) has joined #ceph
[9:18] * Hemanth (~Hemanth@121.244.87.117) has joined #ceph
[9:19] * kefu_ (~kefu@114.86.210.64) has joined #ceph
[9:20] * terje_ (~root@135.109.216.239) has joined #ceph
[9:20] * reinhardt1053 (~reinhardt@195.46.234.215) has joined #ceph
[9:20] * abradsha (~abradshaw@149.6.38.86) has joined #ceph
[9:20] * kefu (~kefu@114.86.210.64) Quit (Ping timeout: 480 seconds)
[9:22] * terje (~root@135.109.216.239) Quit (Ping timeout: 480 seconds)
[9:22] * cooldharma06 (~chatzilla@14.139.180.40) has joined #ceph
[9:23] * smerz (~ircircirc@ip-213-127-160-90.ip.prioritytelecom.net) Quit (Ping timeout: 480 seconds)
[9:26] * smerz (~ircircirc@ip-213-127-160-90.ip.prioritytelecom.net) has joined #ceph
[9:27] * derjohn_mob (~aj@p578b6aa1.dip0.t-ipconnect.de) Quit (Ping timeout: 480 seconds)
[9:30] * Nacer (~Nacer@252-87-190-213.intermediasud.com) has joined #ceph
[9:33] * yghannam (~yghannam@0001f8aa.user.oftc.net) has joined #ceph
[9:33] * capri_on (~capri@212.218.127.222) Quit (Ping timeout: 480 seconds)
[9:34] * Be-El (~quassel@fb08-bcf-pc01.computational.bio.uni-giessen.de) has joined #ceph
[9:34] <Be-El> hi
[9:34] * b0e (~aledermue@213.95.25.82) has joined #ceph
[9:35] * rotbeard (~redbeard@2a02:908:df10:d300:6267:20ff:feb7:c20) Quit (Ping timeout: 480 seconds)
[9:38] * linjan (~linjan@195.91.236.115) has joined #ceph
[9:38] * Concubidated (~Adium@66-87-145-219.pools.spcsdns.net) Quit (Quit: Leaving.)
[9:40] * SinZ|offline (~Qiasfah@5NZAAFFFG.tor-irc.dnsbl.oftc.net) Quit ()
[9:42] * cok (~chk@2a02:2350:18:1010:7479:291f:adbe:15f3) has joined #ceph
[9:42] * analbeard (~shw@support.memset.com) has joined #ceph
[9:44] * dneary_ (~dneary@AGrenoble-651-1-600-61.w90-52.abo.wanadoo.fr) has joined #ceph
[9:55] * derjohn_mob (~aj@94.119.1.52) has joined #ceph
[9:59] * T1w (~jens@node3.survey-it.dk) has joined #ceph
[10:00] * analbeard (~shw@support.memset.com) Quit (Quit: Leaving.)
[10:07] * jordanP (~jordan@scality-jouf-2-194.fib.nerim.net) has joined #ceph
[10:07] * jcsp (~jspray@summerhall-meraki1.fluency.net.uk) has joined #ceph
[10:08] * analbeard (~shw@5.153.255.226) has joined #ceph
[10:13] * terje (~root@135.109.216.239) has joined #ceph
[10:15] * terje_ (~root@135.109.216.239) Quit (Ping timeout: 480 seconds)
[10:22] * kapil (~ksharma@2620:113:80c0:5::2222) Quit (Read error: Connection reset by peer)
[10:24] * terje_ (~root@135.109.216.239) has joined #ceph
[10:26] * terje (~root@135.109.216.239) Quit (Ping timeout: 480 seconds)
[10:29] * terje (~root@135.109.216.239) has joined #ceph
[10:30] * rendar (~I@host57-176-dynamic.55-79-r.retail.telecomitalia.it) has joined #ceph
[10:32] * terje_ (~root@135.109.216.239) Quit (Ping timeout: 480 seconds)
[10:34] * haomaiwang (~haomaiwan@li1072-91.members.linode.com) has joined #ceph
[10:36] * vbellur (~vijay@121.244.87.124) Quit (Ping timeout: 480 seconds)
[10:38] * sleinen (~Adium@2001:620:0:2d:7ed1:c3ff:fedc:3223) Quit (Quit: Leaving.)
[10:39] * terje (~root@135.109.216.239) Quit (Ping timeout: 480 seconds)
[10:45] * Ceph-Log-Bot (~logstash@185.66.248.215) has joined #ceph
[10:45] * Ceph-Log-Bot (~logstash@185.66.248.215) Quit (Read error: Connection reset by peer)
[10:48] <freman> Hi! has anyone eny experience building calamari on centos? without vagrant?
[10:49] * kefu_ is now known as kefu
[10:49] * ngoswami (~ngoswami@121.244.87.116) has joined #ceph
[10:52] * calvinx (~calvin@101.100.172.246) Quit (Quit: calvinx)
[10:52] * p01s0n (~oftc-webi@idp01webcache6-z.apj.hpecore.net) has joined #ceph
[10:53] * wicope (~wicope@0001fd8a.user.oftc.net) has joined #ceph
[10:54] * vbellur (~vijay@121.244.87.124) has joined #ceph
[10:55] * terje (~root@135.109.216.239) has joined #ceph
[10:55] * capri (~capri@212.218.127.222) has joined #ceph
[10:56] <p01s0n> can a 4 node cluster with 3 replicas and 3 OSDs on each server give high availability against single node failure
[10:57] * DV (~veillard@2001:41d0:a:f29f::1) Quit (Ping timeout: 480 seconds)
[10:58] <Nats_> in general yes, as long as number of nodes is >= number of replicas then you can lose a node with no outage
[10:58] * Ceph-Log-Bot (~logstash@185.66.248.215) has joined #ceph
[10:58] * Ceph-Log-Bot (~logstash@185.66.248.215) Quit (Read error: Connection reset by peer)
[11:01] * calvinx (~calvin@101.100.172.246) has joined #ceph
[11:02] <p01s0n> thanks
[11:03] * terje (~root@135.109.216.239) Quit (Ping timeout: 480 seconds)
[11:04] * DV (~veillard@2001:41d0:a:f29f::1) has joined #ceph
[11:06] <s3an2> ndru: Did you set 'show_image_direct_url = True'
[11:12] * rotbeard (~redbeard@185.32.80.238) has joined #ceph
[11:12] * terje (~root@135.109.216.239) has joined #ceph
[11:12] * derjohn_mob (~aj@94.119.1.52) Quit (Ping timeout: 480 seconds)
[11:21] * derjohn_mob (~aj@fw.gkh-setu.de) has joined #ceph
[11:25] * ngoswami (~ngoswami@121.244.87.116) Quit (Quit: Leaving)
[11:27] * terje_ (~root@135.109.216.239) has joined #ceph
[11:29] * terje (~root@135.109.216.239) Quit (Ping timeout: 480 seconds)
[11:29] * kmARC (~kmARC@84-73-73-158.dclient.hispeed.ch) has joined #ceph
[11:30] * ngoswami (~ngoswami@121.244.87.124) has joined #ceph
[11:33] * bitserker (~toni@88.87.194.130) has joined #ceph
[11:35] * i_m (~ivan.miro@83.149.35.66) Quit (Ping timeout: 480 seconds)
[11:35] * terje (~root@135.109.216.239) has joined #ceph
[11:37] * terje_ (~root@135.109.216.239) Quit (Ping timeout: 480 seconds)
[11:38] * karnan (~karnan@121.244.87.117) has joined #ceph
[11:39] * freman (~freman@griffin.seedboxes.cc) Quit (Quit: Lost terminal)
[11:45] * sugoruyo (~georgev@paarthurnax.esc.rl.ac.uk) has joined #ceph
[11:51] * brutuscat (~brutuscat@39.Red-83-47-149.dynamicIP.rima-tde.net) has joined #ceph
[11:56] * jks (~jks@178.155.151.121) has joined #ceph
[11:56] * brutuscat (~brutuscat@39.Red-83-47-149.dynamicIP.rima-tde.net) Quit (Remote host closed the connection)
[11:56] * brutuscat (~brutuscat@39.Red-83-47-149.dynamicIP.rima-tde.net) has joined #ceph
[12:01] * analbeard (~shw@5.153.255.226) Quit (Ping timeout: 480 seconds)
[12:03] * ganebal (~oftc-webi@bzq-82-81-163-130.red.bezeqint.net) has joined #ceph
[12:04] * calvinx (~calvin@101.100.172.246) Quit (Quit: calvinx)
[12:13] * brutuscat (~brutuscat@39.Red-83-47-149.dynamicIP.rima-tde.net) Quit (Read error: Connection reset by peer)
[12:25] * shyu (~Shanzhi@119.254.120.66) Quit (Remote host closed the connection)
[12:26] * brutuscat (~brutuscat@39.Red-83-47-149.dynamicIP.rima-tde.net) has joined #ceph
[12:26] * calvinx (~calvin@101.100.172.246) has joined #ceph
[12:35] * ngoswami (~ngoswami@121.244.87.124) Quit (Quit: Leaving)
[12:39] * lucas1 (~Thunderbi@218.76.52.64) Quit (Quit: lucas1)
[12:39] * ngoswami (~ngoswami@121.244.87.116) has joined #ceph
[12:40] * ZyTer (~ZyTer@ghostbusters.apinnet.fr) Quit (Remote host closed the connection)
[12:44] * zhaochao (~zhaochao@111.161.77.231) Quit (Quit: ChatZilla 0.9.91.1 [Iceweasel 38.1.0/20150711212448])
[12:45] * nardial (~ls@dslb-178-006-188-098.178.006.pools.vodafone-ip.de) has joined #ceph
[12:46] * kefu_ (~kefu@114.86.210.64) has joined #ceph
[12:47] * bitserker (~toni@88.87.194.130) Quit (Quit: Leaving.)
[12:47] * bitserker (~toni@88.87.194.130) has joined #ceph
[12:50] * Ceph-Log-Bot (~logstash@185.66.248.215) has joined #ceph
[12:50] * Ceph-Log-Bot (~logstash@185.66.248.215) Quit (Remote host closed the connection)
[12:51] * kefu (~kefu@114.86.210.64) Quit (Ping timeout: 480 seconds)
[12:51] * nsoffer (~nsoffer@bzq-79-177-255-219.red.bezeqint.net) has joined #ceph
[12:54] * kefu_ is now known as kefu
[12:56] * p01s0n (~oftc-webi@idp01webcache6-z.apj.hpecore.net) Quit (Quit: Page closed)
[12:58] * kefu (~kefu@114.86.210.64) Quit (Max SendQ exceeded)
[13:00] * kefu (~kefu@114.86.210.64) has joined #ceph
[13:01] * Sysadmin88 (~IceChat77@05453139.skybroadband.com) Quit (Quit: Clap on! , Clap off! Clap@#&$NO CARRIER)
[13:07] * Random (~Kayla@192.3.177.167) has joined #ceph
[13:11] <tuxcrafter> http://lists.ceph.com/pipermail/ceph-users-ceph.com/2015-July/003206.html
[13:11] <tuxcrafter> would anyone have any suggestions?
[13:12] <tuxcrafter> i dont know what to do, and I see rebuilding the whole cluster as an only options now, loosing all data, and in production this would be a no-go
[13:15] * doppelgrau (~doppelgra@pd956d116.dip0.t-ipconnect.de) has joined #ceph
[13:15] <Kvisle> tuxcrafter: "If you see this state, try to start any failed OSDs that may contain the needed information or temporarily adjust min_size to allow recovery."
[13:20] * overclk (~overclk@121.244.87.117) Quit (Quit: Leaving)
[13:23] * kefu (~kefu@114.86.210.64) Quit (Max SendQ exceeded)
[13:24] * kefu (~kefu@114.86.210.64) has joined #ceph
[13:26] <tuxcrafter> Kvisle: did that already on advice of someone that replied to the email
[13:26] <tuxcrafter> the minsize is 1
[13:27] * terje (~root@135.109.216.239) Quit (Ping timeout: 480 seconds)
[13:29] <Kvisle> there's always mark_unfound_lost
[13:30] * rwheeler (~rwheeler@pool-173-48-214-9.bstnma.fios.verizon.net) has joined #ceph
[13:31] * terje (~root@135.109.216.239) has joined #ceph
[13:31] * brutuscat (~brutuscat@39.Red-83-47-149.dynamicIP.rima-tde.net) Quit (Read error: Connection reset by peer)
[13:31] * ganders (~root@190.2.42.21) has joined #ceph
[13:34] * rdas (~rdas@121.244.87.116) Quit (Quit: Leaving)
[13:35] <Kvisle> tuxcrafter: https://ceph.com/community/incomplete-pgs-oh-my/
[13:36] * kutija (~kutija@95.180.90.38) Quit (Read error: Connection reset by peer)
[13:36] * kutija (~kutija@95.180.90.38) has joined #ceph
[13:36] * terje_ (~root@135.109.216.239) has joined #ceph
[13:37] * Random (~Kayla@7R2AACYWQ.tor-irc.dnsbl.oftc.net) Quit ()
[13:38] * brutuscat (~brutuscat@39.Red-83-47-149.dynamicIP.rima-tde.net) has joined #ceph
[13:39] * ira (~ira@c-71-233-225-22.hsd1.ma.comcast.net) has joined #ceph
[13:39] * terje (~root@135.109.216.239) Quit (Ping timeout: 480 seconds)
[13:41] * badone (~brad@CPE-121-215-241-179.static.qld.bigpond.net.au) Quit (Ping timeout: 480 seconds)
[13:48] * kefu (~kefu@114.86.210.64) Quit (Max SendQ exceeded)
[13:49] * kefu (~kefu@114.86.210.64) has joined #ceph
[13:51] * terje_ (~root@135.109.216.239) Quit (Ping timeout: 480 seconds)
[13:52] * muni (~muni@bzq-218-200-252.red.bezeqint.net) has joined #ceph
[13:55] * terje (~root@135.109.216.239) has joined #ceph
[13:57] * cooldharma06 (~chatzilla@14.139.180.40) Quit (Quit: ChatZilla 0.9.91.1 [Iceweasel 21.0/20130515140136])
[13:58] * kefu (~kefu@114.86.210.64) Quit (Max SendQ exceeded)
[13:59] * kefu (~kefu@114.86.210.64) has joined #ceph
[14:01] * terje_ (~root@135.109.216.239) has joined #ceph
[14:03] * kefu (~kefu@114.86.210.64) Quit (Max SendQ exceeded)
[14:03] * terje (~root@135.109.216.239) Quit (Ping timeout: 480 seconds)
[14:04] * kefu (~kefu@114.86.210.64) has joined #ceph
[14:04] * doucetp (~doucetp@192.93.37.4) has joined #ceph
[14:06] * brutuscat (~brutuscat@39.Red-83-47-149.dynamicIP.rima-tde.net) Quit (Read error: Connection reset by peer)
[14:08] * t0rn (~ssullivan@2607:fad0:32:a02:56ee:75ff:fe48:3bd3) has joined #ceph
[14:09] * overclk (~overclk@117.202.109.71) has joined #ceph
[14:10] * brutuscat (~brutuscat@39.Red-83-47-149.dynamicIP.rima-tde.net) has joined #ceph
[14:10] * t0rn (~ssullivan@2607:fad0:32:a02:56ee:75ff:fe48:3bd3) has left #ceph
[14:11] * kefu (~kefu@114.86.210.64) Quit (Max SendQ exceeded)
[14:12] * kefu (~kefu@114.86.210.64) has joined #ceph
[14:12] * Kioob`Taff (~plug-oliv@2a01:e35:2e8a:1e0::42:10) has joined #ceph
[14:14] * ganebal (~oftc-webi@bzq-82-81-163-130.red.bezeqint.net) Quit (Remote host closed the connection)
[14:16] * calvinx (~calvin@101.100.172.246) Quit (Quit: calvinx)
[14:16] * terje_ (~root@135.109.216.239) Quit (Ping timeout: 480 seconds)
[14:17] * kefu (~kefu@114.86.210.64) Quit (Max SendQ exceeded)
[14:17] * kanagaraj (~kanagaraj@121.244.87.117) Quit (Quit: Leaving)
[14:19] * kefu (~kefu@114.86.210.64) has joined #ceph
[14:20] * terje (~root@135.109.216.239) has joined #ceph
[14:22] * kefu (~kefu@114.86.210.64) Quit (Max SendQ exceeded)
[14:22] * nardial (~ls@dslb-178-006-188-098.178.006.pools.vodafone-ip.de) Quit (Remote host closed the connection)
[14:23] * kefu (~kefu@114.86.210.64) has joined #ceph
[14:24] * nardial (~ls@dslb-178-006-188-098.178.006.pools.vodafone-ip.de) has joined #ceph
[14:27] * shylesh__ (~shylesh@121.244.87.124) Quit (Remote host closed the connection)
[14:27] * kefu (~kefu@114.86.210.64) Quit (Max SendQ exceeded)
[14:28] * terje_ (~root@135.109.216.239) has joined #ceph
[14:28] * kefu (~kefu@114.86.210.64) has joined #ceph
[14:29] * vbellur (~vijay@121.244.87.124) Quit (Ping timeout: 480 seconds)
[14:30] * terje (~root@135.109.216.239) Quit (Ping timeout: 480 seconds)
[14:32] * lathiat_ (~lathiat@2403:dc00::117) Quit (Ping timeout: 480 seconds)
[14:33] * kefu (~kefu@114.86.210.64) Quit (Max SendQ exceeded)
[14:33] * fridim_ (~fridim@56-198-190-109.dsl.ovh.fr) Quit (Ping timeout: 480 seconds)
[14:34] * kefu (~kefu@114.86.210.64) has joined #ceph
[14:35] * terje (~root@135.109.216.239) has joined #ceph
[14:36] * terje_ (~root@135.109.216.239) Quit (Ping timeout: 480 seconds)
[14:38] * kefu (~kefu@114.86.210.64) Quit (Max SendQ exceeded)
[14:40] * Hemanth (~Hemanth@121.244.87.117) Quit (Quit: Leaving)
[14:42] <Kioob`Taff> 2015-07-23 14:27:22.020790 7fbd92954700 1 journal check_for_full at 453410816 : JOURNAL FULL 453410816 >= 110591 (max_size 4294967296 start 453521408)
[14:42] <Kioob`Taff> how should I read that ?
[14:43] * fridim_ (~fridim@56-198-190-109.dsl.ovh.fr) has joined #ceph
[14:44] * brutuscat (~brutuscat@39.Red-83-47-149.dynamicIP.rima-tde.net) Quit (Read error: Connection reset by peer)
[14:44] * kefu (~kefu@114.86.210.64) has joined #ceph
[14:44] * terje (~root@135.109.216.239) Quit (Ping timeout: 480 seconds)
[14:46] * nardial (~ls@dslb-178-006-188-098.178.006.pools.vodafone-ip.de) Quit (Quit: Leaving)
[14:48] * kefu (~kefu@114.86.210.64) Quit (Max SendQ exceeded)
[14:49] * kefu (~kefu@114.86.210.64) has joined #ceph
[14:51] * kefu (~kefu@114.86.210.64) Quit (Max SendQ exceeded)
[14:51] * kevinperks (~Adium@2606:a000:80ad:1300:2d05:5670:bb91:82cb) has joined #ceph
[14:52] * kefu (~kefu@114.86.210.64) has joined #ceph
[14:52] * brutuscat (~brutuscat@39.Red-83-47-149.dynamicIP.rima-tde.net) has joined #ceph
[14:53] * terje (~root@135.109.216.239) has joined #ceph
[14:54] * overclk (~overclk@117.202.109.71) Quit (Remote host closed the connection)
[14:57] * overclk (~overclk@117.202.109.71) has joined #ceph
[14:57] <Kioob`Taff> in my logs, I see :
[14:57] <Kioob`Taff> journal check_for_full at 98713600 : JOURNAL FULL 98713600 >= 40959
[14:57] <Kioob`Taff> journal check_for_full at 2570735616 : JOURNAL FULL 2570735616 >= 118783
[14:57] <Kioob`Taff> journal check_for_full at 2599002112 : JOURNAL FULL 2599002112 >= 65535
[14:57] <Kioob`Taff> journal check_for_full at 453410816 : JOURNAL FULL 453410816 >= 110591
[14:58] <Kioob`Taff> I would like to know what is that list number
[14:58] <Kioob`Taff> I don't find any option about that
[14:59] * kefu (~kefu@114.86.210.64) Quit (Max SendQ exceeded)
[14:59] * linjan (~linjan@195.91.236.115) Quit (Ping timeout: 480 seconds)
[15:00] * kefu (~kefu@114.86.210.64) has joined #ceph
[15:02] * terje_ (~root@135.109.216.239) has joined #ceph
[15:04] * terje (~root@135.109.216.239) Quit (Ping timeout: 480 seconds)
[15:05] * sjm (~sjm@pool-100-1-115-73.nwrknj.fios.verizon.net) has joined #ceph
[15:05] * kefu (~kefu@114.86.210.64) Quit (Max SendQ exceeded)
[15:06] * kefu (~kefu@114.86.210.64) has joined #ceph
[15:06] * rlrevell (~leer@vbo1.inmotionhosting.com) has joined #ceph
[15:08] * terje (~root@135.109.216.239) has joined #ceph
[15:09] <Kioob`Taff> 110591 seems way too small for the journal size (the dedicated partition has a 4GB size)
[15:09] * tupper (~tcole@173.38.117.72) has joined #ceph
[15:10] * sleinen (~Adium@2001:620:0:2d:7ed1:c3ff:fedc:3223) has joined #ceph
[15:10] * terje_ (~root@135.109.216.239) Quit (Ping timeout: 480 seconds)
[15:11] * kefu (~kefu@114.86.210.64) Quit (Max SendQ exceeded)
[15:12] * kefu (~kefu@114.86.210.64) has joined #ceph
[15:14] * wschulze (~wschulze@cpe-69-206-240-164.nyc.res.rr.com) has joined #ceph
[15:14] * muni (~muni@bzq-218-200-252.red.bezeqint.net) Quit (Ping timeout: 480 seconds)
[15:15] * overclk (~overclk@117.202.109.71) Quit (Remote host closed the connection)
[15:15] * brad_mssw (~brad@66.129.88.50) has joined #ceph
[15:16] * terje_ (~root@135.109.216.239) has joined #ceph
[15:18] * terje (~root@135.109.216.239) Quit (Ping timeout: 480 seconds)
[15:20] * neurodrone (~neurodron@108.60.145.130) Quit (Ping timeout: 480 seconds)
[15:21] * kefu (~kefu@114.86.210.64) Quit (Max SendQ exceeded)
[15:21] * kefu (~kefu@114.86.210.64) has joined #ceph
[15:23] * i_m (~ivan.miro@88.206.99.242) has joined #ceph
[15:24] * terje_ (~root@135.109.216.239) Quit (Ping timeout: 480 seconds)
[15:24] * muni (~muni@bzq-218-200-252.red.bezeqint.net) has joined #ceph
[15:28] * terje (~root@135.109.216.239) has joined #ceph
[15:30] * kefu (~kefu@114.86.210.64) Quit (Max SendQ exceeded)
[15:30] * brutuscat (~brutuscat@39.Red-83-47-149.dynamicIP.rima-tde.net) Quit (Read error: Connection reset by peer)
[15:31] * kefu (~kefu@114.86.210.64) has joined #ceph
[15:31] * scott__ (~scott@dc.gigenet.com) has joined #ceph
[15:32] * DV (~veillard@2001:41d0:a:f29f::1) Quit (Remote host closed the connection)
[15:33] * brutuscat (~brutuscat@39.Red-83-47-149.dynamicIP.rima-tde.net) has joined #ceph
[15:34] * kefu (~kefu@114.86.210.64) Quit (Max SendQ exceeded)
[15:34] * georgem (~Adium@206.108.127.16) has joined #ceph
[15:34] * terje_ (~root@135.109.216.239) has joined #ceph
[15:36] <scott__> Has anyone intergrated Ceph with Ceilometer in Openstack Kilo release. I see they have added, radosgw = object-store. Wondering if I can get some assistance with it.
[15:36] * cooldharma06 (~chatzilla@14.139.180.40) has joined #ceph
[15:36] * kefu (~kefu@114.86.210.64) has joined #ceph
[15:36] * terje (~root@135.109.216.239) Quit (Ping timeout: 480 seconds)
[15:38] * DV (~veillard@2001:41d0:1:d478::1) has joined #ceph
[15:38] * kefu (~kefu@114.86.210.64) Quit (Max SendQ exceeded)
[15:39] * overclk (~overclk@117.202.109.71) has joined #ceph
[15:39] * kefu (~kefu@114.86.210.64) has joined #ceph
[15:42] * terje (~root@135.109.216.239) has joined #ceph
[15:42] * vbellur (~vijay@122.171.200.74) has joined #ceph
[15:43] * kefu (~kefu@114.86.210.64) Quit (Max SendQ exceeded)
[15:44] * wesley (~wesley@spider.pfoe.be) has joined #ceph
[15:44] * terje_ (~root@135.109.216.239) Quit (Ping timeout: 480 seconds)
[15:44] * wesley is now known as zw
[15:44] * harold (~hamiller@71-94-227-123.dhcp.mdfd.or.charter.com) has joined #ceph
[15:44] * kefu (~kefu@114.86.210.64) has joined #ceph
[15:45] * lathiat (~lathiat@2403:dc00::117) has joined #ceph
[15:46] * analbeard (~shw@5.153.255.226) has joined #ceph
[15:49] * overclk (~overclk@117.202.109.71) Quit (Remote host closed the connection)
[15:50] * terje (~root@135.109.216.239) Quit (Ping timeout: 480 seconds)
[15:52] * wicope (~wicope@0001fd8a.user.oftc.net) Quit (Remote host closed the connection)
[15:56] * shang (~ShangWu@175.41.48.77) Quit (Remote host closed the connection)
[15:58] * Concubidated (~Adium@161.225.196.30) has joined #ceph
[15:58] * kefu is now known as kefu|afk
[16:01] * kefu|afk (~kefu@114.86.210.64) Quit (Max SendQ exceeded)
[16:01] * brutuscat (~brutuscat@39.Red-83-47-149.dynamicIP.rima-tde.net) Quit (Read error: Connection reset by peer)
[16:01] * kefu (~kefu@114.86.210.64) has joined #ceph
[16:02] * T1w (~jens@node3.survey-it.dk) Quit (Ping timeout: 480 seconds)
[16:05] * terje (~root@135.109.216.239) has joined #ceph
[16:06] * linjan (~linjan@195.91.134.130) has joined #ceph
[16:06] * lpabon_ (~quassel@24-151-54-34.dhcp.nwtn.ct.charter.com) has joined #ceph
[16:06] * brutuscat (~brutuscat@39.Red-83-47-149.dynamicIP.rima-tde.net) has joined #ceph
[16:06] * lpabon_ (~quassel@24-151-54-34.dhcp.nwtn.ct.charter.com) Quit (Remote host closed the connection)
[16:07] * lpabon (~quassel@nat-pool-bos-t.redhat.com) Quit (Remote host closed the connection)
[16:10] * georgem (~Adium@206.108.127.16) Quit (Quit: Leaving.)
[16:12] * jcsp (~jspray@summerhall-meraki1.fluency.net.uk) Quit (Ping timeout: 480 seconds)
[16:13] * georgem (~Adium@206.108.127.16) has joined #ceph
[16:14] * terje (~root@135.109.216.239) Quit (Ping timeout: 480 seconds)
[16:17] * overclk (~overclk@117.202.109.71) has joined #ceph
[16:18] * terje (~root@135.109.216.239) has joined #ceph
[16:19] * overclk (~overclk@117.202.109.71) Quit (Read error: Connection reset by peer)
[16:19] * yanzheng (~zhyan@182.139.21.196) Quit (Quit: This computer has gone to sleep)
[16:19] * neurodrone (~neurodron@108.60.145.130) has joined #ceph
[16:19] * overclk (~overclk@117.202.109.71) has joined #ceph
[16:20] * georgem (~Adium@206.108.127.16) Quit (Quit: Leaving.)
[16:20] * thomnico (~thomnico@2a01:e35:8b41:120:cdbb:6d6c:1450:cf42) has joined #ceph
[16:21] * abradsha (~abradshaw@149.6.38.86) Quit (Ping timeout: 480 seconds)
[16:26] * terje (~root@135.109.216.239) Quit (Ping timeout: 480 seconds)
[16:28] * spate (~Esvandiar@johnborjomi.com) has joined #ceph
[16:28] * yanzheng (~zhyan@182.139.21.196) has joined #ceph
[16:29] * analbeard (~shw@5.153.255.226) Quit (Remote host closed the connection)
[16:30] * analbeard (~shw@5.153.255.226) has joined #ceph
[16:30] * ircolle (~Adium@2601:285:201:2bf9:7998:332f:4c2b:a5be) has joined #ceph
[16:31] * georgem (~Adium@206.108.127.16) has joined #ceph
[16:32] * ChrisNBlum (~ChrisNBlu@dhcp-ip-217.dorf.rwth-aachen.de) Quit (Ping timeout: 480 seconds)
[16:32] * karnan (~karnan@121.244.87.117) Quit (Ping timeout: 480 seconds)
[16:34] * ChrisNBlum (~ChrisNBlu@dhcp-ip-217.dorf.rwth-aachen.de) has joined #ceph
[16:35] * yanzheng (~zhyan@182.139.21.196) Quit (Quit: This computer has gone to sleep)
[16:35] * analbeard (~shw@5.153.255.226) Quit (Remote host closed the connection)
[16:36] * terje (~root@135.109.216.239) has joined #ceph
[16:36] * lpabon (~quassel@24-151-54-34.dhcp.nwtn.ct.charter.com) has joined #ceph
[16:36] * arbrandes (~arbrandes@179.210.13.90) has joined #ceph
[16:42] * overclk (~overclk@117.202.109.71) Quit (Remote host closed the connection)
[16:42] * ngoswami (~ngoswami@121.244.87.116) Quit (Quit: Leaving)
[16:42] * jcsp (~jspray@82-71-16-249.dsl.in-addr.zen.co.uk) has joined #ceph
[16:43] * yguang11 (~yguang11@c-50-131-146-113.hsd1.ca.comcast.net) has joined #ceph
[16:44] * terje (~root@135.109.216.239) Quit (Ping timeout: 480 seconds)
[16:44] * ira (~ira@c-71-233-225-22.hsd1.ma.comcast.net) Quit (Remote host closed the connection)
[16:45] * kefu (~kefu@114.86.210.64) Quit (Max SendQ exceeded)
[16:46] * kefu (~kefu@114.86.210.64) has joined #ceph
[16:48] * terje (~root@135.109.216.239) has joined #ceph
[16:48] * jwilkins (~jwilkins@c-67-180-123-48.hsd1.ca.comcast.net) Quit (Quit: Leaving)
[16:49] * jwilkins (~jwilkins@c-67-180-123-48.hsd1.ca.comcast.net) has joined #ceph
[16:49] * gucki (~smuxi@office.netskin.com) Quit (Ping timeout: 480 seconds)
[16:50] * ngoswami (~ngoswami@121.244.87.116) has joined #ceph
[16:51] * pdrakewe_ (~pdrakeweb@cpe-65-185-74-239.neo.res.rr.com) has joined #ceph
[16:52] * ganders (~root@190.2.42.21) Quit (Ping timeout: 480 seconds)
[16:52] * cok (~chk@2a02:2350:18:1010:7479:291f:adbe:15f3) has left #ceph
[16:52] * kefu (~kefu@114.86.210.64) Quit (Max SendQ exceeded)
[16:53] * yguang11 (~yguang11@c-50-131-146-113.hsd1.ca.comcast.net) Quit (Remote host closed the connection)
[16:54] * terje_ (~root@135.109.216.239) has joined #ceph
[16:54] * kefu (~kefu@114.86.210.64) has joined #ceph
[16:56] * terje (~root@135.109.216.239) Quit (Ping timeout: 480 seconds)
[16:57] * brutuscat (~brutuscat@39.Red-83-47-149.dynamicIP.rima-tde.net) Quit (Read error: Connection reset by peer)
[16:57] * shohn (~shohn@164.139.7.150) has left #ceph
[16:57] * pdrakeweb (~pdrakeweb@cpe-65-185-74-239.neo.res.rr.com) Quit (Ping timeout: 480 seconds)
[16:58] * spate (~Esvandiar@5NZAAFF4J.tor-irc.dnsbl.oftc.net) Quit ()
[16:59] * harold (~hamiller@71-94-227-123.dhcp.mdfd.or.charter.com) Quit (Quit: Leaving)
[16:59] * kefu_ (~kefu@120.204.164.217) has joined #ceph
[17:02] * terje (~root@135.109.216.239) has joined #ceph
[17:02] * nardial (~ls@dslb-178-006-188-098.178.006.pools.vodafone-ip.de) has joined #ceph
[17:04] * terje_ (~root@135.109.216.239) Quit (Ping timeout: 480 seconds)
[17:04] * muni (~muni@bzq-218-200-252.red.bezeqint.net) Quit (Ping timeout: 480 seconds)
[17:06] * kefu (~kefu@114.86.210.64) Quit (Ping timeout: 480 seconds)
[17:07] * yanzheng (~zhyan@182.139.21.196) has joined #ceph
[17:10] * TheSov (~TheSov@204.13.200.248) has joined #ceph
[17:10] <TheSov> using cephfs requires a metadata server correct?
[17:10] * ira (~ira@c-71-233-225-22.hsd1.ma.comcast.net) has joined #ceph
[17:12] * brutuscat (~brutuscat@39.Red-83-47-149.dynamicIP.rima-tde.net) has joined #ceph
[17:12] <smerz> yes
[17:13] * yanzheng (~zhyan@182.139.21.196) Quit (Quit: This computer has gone to sleep)
[17:15] <TheSov> ok just out of curiosity, why can there only be 1 active metadata server?
[17:16] * demonspork (~Shadow386@h-213.61.149.100.host.de.colt.net) has joined #ceph
[17:17] * dougf (~dougf@96-38-99-179.dhcp.jcsn.tn.charter.com) Quit (Ping timeout: 480 seconds)
[17:18] <m0zes> because multimds is a *very* experimental feature.
[17:19] * thomnico (~thomnico@2a01:e35:8b41:120:cdbb:6d6c:1450:cf42) Quit (Ping timeout: 480 seconds)
[17:20] <m0zes> probably a locking/coherency nightmare. not as many eyes on the code, and cephfs is only now getting to the point where it can be considered for production systems.
[17:21] * capri_on (~capri@212.218.127.222) has joined #ceph
[17:22] * georgem (~Adium@206.108.127.16) Quit (Quit: Leaving.)
[17:23] <TheSov> so the only thing production ready as of right now is RBD?
[17:23] * georgem (~Adium@206.108.127.16) has joined #ceph
[17:24] * capri (~capri@212.218.127.222) Quit (Ping timeout: 480 seconds)
[17:25] * cholcombe (~chris@c-73-180-29-35.hsd1.or.comcast.net) has joined #ceph
[17:25] <m0zes> rbd, rados proper, rgw.
[17:25] * kefu_ is now known as kefu|afk
[17:25] <m0zes> I'm deploying cephfs at the moment.
[17:26] <TheSov> when you say rados proper, how would one use that?
[17:26] <m0zes> 2PB raw, going to expand to 3PB shortly.
[17:26] <m0zes> http://ceph.com/docs/master/rados/api/
[17:27] <TheSov> so essentially anything that uses librados
[17:27] * kefu|afk is now known as kefu_
[17:27] <TheSov> so i want to build an active/active HA nfs server
[17:28] <TheSov> https://access.redhat.com/documentation/en-US/Red_Hat_Enterprise_Linux/3/html/Cluster_Administration/s1-service-nfsactive.html
[17:29] <TheSov> basically i just wanted to replace the DRDB part with an RBD thats attached to both machines
[17:29] <TheSov> I wanted to know if thats possible
[17:30] <TheSov> err i linked the wrong article, ignore that
[17:30] * joshd1 (~jdurgin@68-119-140-18.dhcp.ahvl.nc.charter.com) has joined #ceph
[17:31] * xarses_ (~xarses@c-73-202-191-48.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[17:32] * moore (~moore@64.202.160.88) has joined #ceph
[17:33] <m0zes> I don't know how well multi-writer rbd access is tested. I know I've not done it.
[17:34] * nardial (~ls@dslb-178-006-188-098.178.006.pools.vodafone-ip.de) Quit (Quit: Leaving)
[17:35] * brutuscat (~brutuscat@39.Red-83-47-149.dynamicIP.rima-tde.net) Quit (Remote host closed the connection)
[17:35] * dougf (~dougf@96-38-99-179.dhcp.jcsn.tn.charter.com) has joined #ceph
[17:37] * smerz (~ircircirc@ip-213-127-160-90.ip.prioritytelecom.net) Quit (Ping timeout: 480 seconds)
[17:42] * rotbeard (~redbeard@185.32.80.238) Quit (Quit: Leaving)
[17:42] * ira (~ira@c-71-233-225-22.hsd1.ma.comcast.net) Quit (Remote host closed the connection)
[17:42] * overclk (~overclk@117.202.109.71) has joined #ceph
[17:43] * schrodinger (~schroding@genius.konundrum.org) Quit (Ping timeout: 480 seconds)
[17:44] * derjohn_mob (~aj@fw.gkh-setu.de) Quit (Ping timeout: 480 seconds)
[17:46] * demonspork (~Shadow386@7R2AACY6Q.tor-irc.dnsbl.oftc.net) Quit ()
[17:48] * yguang11 (~yguang11@2001:4998:effd:600:243a:dd5a:f78f:219d) has joined #ceph
[17:49] * schrodinger (~schroding@genius.konundrum.org) has joined #ceph
[17:50] * overclk (~overclk@117.202.109.71) Quit (Ping timeout: 480 seconds)
[17:51] * xarses_ (~xarses@12.164.168.117) has joined #ceph
[17:52] <nils_> can I change filestore max sync interval online (using hammer)
[17:54] * derjohn_mob (~aj@fw.gkh-setu.de) has joined #ceph
[17:54] * alram (~alram@cpe-172-250-2-46.socal.res.rr.com) has joined #ceph
[17:57] * jrankin (~jrankin@d53-64-170-236.nap.wideopenwest.com) has joined #ceph
[17:57] * kefu_ (~kefu@120.204.164.217) Quit (Max SendQ exceeded)
[17:57] * kefu (~kefu@120.204.164.217) has joined #ceph
[17:59] <haomaiwang> nils_: yes
[18:00] * ninkotech (~duplo@static-84-242-87-186.net.upcbroadband.cz) has joined #ceph
[18:00] * brutuscat (~brutuscat@39.Red-83-47-149.dynamicIP.rima-tde.net) has joined #ceph
[18:01] * dgurtner (~dgurtner@178.197.231.188) Quit (Ping timeout: 480 seconds)
[18:02] * angdraug (~angdraug@c-50-174-102-105.hsd1.ca.comcast.net) has joined #ceph
[18:03] * mhack (~mhack@nat-pool-bos-t.redhat.com) Quit (Remote host closed the connection)
[18:03] * angdraug (~angdraug@c-50-174-102-105.hsd1.ca.comcast.net) Quit ()
[18:04] * kefu is now known as kefu|afk
[18:05] * reinhardt1053 (~reinhardt@195.46.234.215) Quit (Remote host closed the connection)
[18:05] * dynamicudpate (~overonthe@199.68.193.54) Quit (Read error: Connection reset by peer)
[18:06] * mhack (~mhack@nat-pool-bos-t.redhat.com) has joined #ceph
[18:07] * Nacer_ (~Nacer@252-87-190-213.intermediasud.com) has joined #ceph
[18:07] * Nacer (~Nacer@252-87-190-213.intermediasud.com) Quit (Read error: Connection reset by peer)
[18:08] * doucetp (~doucetp@192.93.37.4) Quit (Quit: Quitte)
[18:08] * kefu|afk is now known as kefu
[18:09] * doucetp_ (~doucetp@192.93.37.4) Quit (Quit: Quitte)
[18:12] * jordanP (~jordan@scality-jouf-2-194.fib.nerim.net) Quit (Ping timeout: 480 seconds)
[18:14] * brutuscat (~brutuscat@39.Red-83-47-149.dynamicIP.rima-tde.net) Quit (Read error: Connection reset by peer)
[18:16] * b0e (~aledermue@213.95.25.82) Quit (Quit: Leaving.)
[18:17] * ganders (~root@190.2.42.21) has joined #ceph
[18:17] * jordanP (~jordan@scality-jouf-2-194.fib.nerim.net) has joined #ceph
[18:18] * brutuscat (~brutuscat@39.Red-83-47-149.dynamicIP.rima-tde.net) has joined #ceph
[18:19] * kamalmarhubi (sid26581@id-26581.highgate.irccloud.com) Quit ()
[18:19] * kamalmarhubi (sid26581@id-26581.tooting.irccloud.com) has joined #ceph
[18:20] * kefu_ (~kefu@114.86.210.64) has joined #ceph
[18:20] * nsoffer (~nsoffer@bzq-79-177-255-219.red.bezeqint.net) Quit (Ping timeout: 480 seconds)
[18:20] <nils_> my ceph OSD sometimes die with a failed assertion: http://pastebin.com/W19dJ5Hi
[18:22] * linjan (~linjan@195.91.134.130) Quit (Ping timeout: 480 seconds)
[18:24] * linjan (~linjan@195.91.134.130) has joined #ceph
[18:25] * Nacer_ (~Nacer@252-87-190-213.intermediasud.com) Quit (Ping timeout: 480 seconds)
[18:25] * linuxkidd (~linuxkidd@li824-68.members.linode.com) has joined #ceph
[18:26] <nils_> I should probably rebuild that particular OSD?
[18:27] * kefu (~kefu@120.204.164.217) Quit (Ping timeout: 480 seconds)
[18:31] * carmstrong (sid22558@id-22558.highgate.irccloud.com) Quit ()
[18:31] * carmstrong (sid22558@id-22558.tooting.irccloud.com) has joined #ceph
[18:33] * kefu_ is now known as kefu|afk
[18:35] * linjan (~linjan@195.91.134.130) Quit (Ping timeout: 480 seconds)
[18:35] * TMM (~hp@178-84-46-106.dynamic.upc.nl) Quit (Ping timeout: 480 seconds)
[18:37] * TMM (~hp@178-84-46-106.dynamic.upc.nl) has joined #ceph
[18:37] * dopesong (~dopesong@88-119-94-55.static.zebra.lt) has joined #ceph
[18:38] * sugoruyo (~georgev@paarthurnax.esc.rl.ac.uk) Quit (Quit: I'm going home!)
[18:39] * dopeson__ (~dopesong@88-119-94-55.static.zebra.lt) has joined #ceph
[18:44] * kefu|afk (~kefu@114.86.210.64) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[18:45] * dopesong_ (~dopesong@lb1.mailer.data.lt) Quit (Ping timeout: 480 seconds)
[18:46] * kefu (~kefu@114.86.210.64) has joined #ceph
[18:46] * dopesong (~dopesong@88-119-94-55.static.zebra.lt) Quit (Ping timeout: 480 seconds)
[18:47] * dopeson__ (~dopesong@88-119-94-55.static.zebra.lt) Quit (Ping timeout: 480 seconds)
[18:51] * kawa2014 (~kawa@89.184.114.246) Quit (Quit: Leaving)
[18:55] * reed (~reed@67.23.204.130) has joined #ceph
[18:55] * kefu (~kefu@114.86.210.64) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[18:55] <TheSov> sounds like osd5 is a bad disk
[18:55] * sleinen (~Adium@2001:620:0:2d:7ed1:c3ff:fedc:3223) Quit (Quit: Leaving.)
[18:55] <TheSov> or looks rather
[18:56] * thomnico (~thomnico@cro38-2-88-180-16-18.fbx.proxad.net) has joined #ceph
[18:56] * kefu (~kefu@114.86.210.64) has joined #ceph
[18:56] <TheSov> its almost as if osd's are sensitive and made to crash somewhat easily so they dont cause issues
[18:57] <TheSov> like they would commit suicide rather than try to do things like issue disk repairs
[18:57] <TheSov> or sector remaps
[18:57] * kefu (~kefu@114.86.210.64) Quit ()
[18:57] <TheSov> which i consider to be better, because commodity disk is cheap and there is no reason to waste time on it
[18:58] * kefu (~kefu@114.86.210.64) has joined #ceph
[18:58] * kefu (~kefu@114.86.210.64) Quit ()
[18:59] * derjohn_mob (~aj@fw.gkh-setu.de) Quit (Ping timeout: 480 seconds)
[18:59] <nils_> TheSov: the OS doesn't report an error and a scrub of the filesystem also doesn't report errors. May be a problem with btrfs
[19:00] <TheSov> well, ceph explicitly says that btrfs stuff is still experimental
[19:01] <TheSov> for stability u want xfs
[19:01] <nils_> yeah I should probably migrate the remaining OSDs to XFS
[19:01] * jordanP (~jordan@scality-jouf-2-194.fib.nerim.net) Quit (Quit: Leaving)
[19:03] <TheSov> im trying to find an ultra cheap x86_64 machine to make a small scale cluster
[19:04] <TheSov> the cheapest machine for the capability right now that is see is a super micro 36 drive system. which is huge
[19:04] <TheSov> it can hold the most osd for the cost
[19:04] * mattch (~mattch@pcw3047.see.ed.ac.uk) Quit (Quit: Leaving.)
[19:04] <TheSov> i was thinking atom servers but they are 600 for a 1u 4 disk system
[19:04] <TheSov> with no drives or memory
[19:05] <nils_> and you still want ECC memory at least, right?
[19:05] <TheSov> of course
[19:05] <TheSov> the 600 dollar atom uses ecc
[19:05] <nils_> Avoton 8 core?
[19:05] <TheSov> never heard of it
[19:05] <nils_> C2770 or whatever the hell they are called?
[19:06] <TheSov> it that an ITX or somethin
[19:06] * jwilkins (~jwilkins@c-67-180-123-48.hsd1.ca.comcast.net) Quit (Remote host closed the connection)
[19:06] <nils_> http://www.supermicro.nl/products/motherboard/Atom/X10/A1SAi-2750F.cfm
[19:07] <nils_> the problem with a 36 drive system is that you'll need additional sata/sas controllers
[19:07] <TheSov> of course
[19:07] <nils_> they either come in cheap and broken or expensive...
[19:07] <TheSov> super micro controllers are good and cheap
[19:07] <TheSov> 8 disks per controller
[19:11] * snakamoto (~Adium@192.16.26.2) has joined #ceph
[19:13] * Be-El (~quassel@fb08-bcf-pc01.computational.bio.uni-giessen.de) Quit (Remote host closed the connection)
[19:13] <zw> Hi there
[19:13] <ska> Is there a ceph command or Calamari api command that provides IP-addresses for hosts?
[19:13] <zw> Do I find myself in a very interesting discussion here ? What hardware to use for ceph ? :)
[19:14] * Nacer (~Nacer@2001:41d0:fe82:7200:e037:711a:c339:d1c7) has joined #ceph
[19:14] <zw> We are planning to start a first ceph cluster and I'm talking to Dell en HP for hardware ...
[19:14] <zw> Is supermicro a good alternative ?
[19:15] <ska> zw, too many variables, but go for reliability and good IO..
[19:15] <ska> zw: I'v had good luck with Supermicro, but never deployed Ceph with it.
[19:15] <doppelgrau> ska: cheph osd find?
[19:16] * m0zes doesn't mind supermicro hardware, but questions his vendor's ability to perform timely maintenance/replacements. we went with dell.
[19:17] <zw> m0zes: you are also running a ceph cluster on dell boxes ?
[19:17] <m0zes> zw, yep. went with dell.
[19:17] * brutuscat (~brutuscat@39.Red-83-47-149.dynamicIP.rima-tde.net) Quit (Read error: Connection reset by peer)
[19:18] * jrankin (~jrankin@d53-64-170-236.nap.wideopenwest.com) Quit (Quit: Leaving)
[19:19] <m0zes> PE R730XD (12x 6TB 3.5" disks, 4x 4TB 3.5" disks, 2x SSDs. 24 nodes) Avoid the "read optimized" ssds from dell. they are lite-on crap.
[19:20] <snakamoto> m0zes: are the 4 4tb drives for OS?
[19:20] <ska> zw, also depends on your budget.
[19:21] <m0zes> the SSDs are for OS. Tried to use them for Journals and a small caching tier as well, but the performance was so terrible that we scrapped that plan.
[19:21] <m0zes> snakamoto: the 4TB disks are for OSDs. Dell hadn't certified the 6TB drives for internal use when we purchased earlier this year.
[19:22] <snakamoto> got it, so on-OSD journals
[19:22] <m0zes> yep.
[19:23] <snakamoto> I'm guessing having the SSD do triple duty and the 8:1 OSD:journal ratio was the culprit?
[19:23] <snakamoto> we're getting ready to do the R730XDs as well for a cluster
[19:24] <snakamoto> 14x 4TB (OSD), 2x SSD (OS), 2x SSD (journals)
[19:24] <m0zes> 8:1 was the only way to get the performance numbers out of the SSDs that were claimed. there was just too much latency per operation.
[19:24] <zw> m0zes: how do you handle the build in raid ? Is there a way to order 730xd's without raid controller ? :)
[19:24] * brutuscat (~brutuscat@39.Red-83-47-149.dynamicIP.rima-tde.net) has joined #ceph
[19:24] <snakamoto> I'm curious as well which controller you went with
[19:25] <m0zes> zw: 'PERC H730 Integrated RAID Controller, 1GB Cache (405-AAEG)' and no raid setup. they were jbod by default.
[19:26] <zw> m0zes: cool. I'm new to ceph, did not know that you could put journals elsewhere
[19:26] <zw> on ssd for example
[19:27] <zw> m0zes: how large is your cluster ?
[19:27] <m0zes> on ssd is the ideal, if you get decent ssds. people recommend the intel dc s3700 series, iirc.
[19:27] <m0zes> 24 nodes, ~2.2 PB.
[19:28] <zw> WTF?
[19:28] <zw> Omg man, that is huge :)
[19:28] <zw> Cool.
[19:28] * reed (~reed@67.23.204.130) Quit (Ping timeout: 480 seconds)
[19:28] <m0zes> we're expanding shortly too. we're repurposing old fileservers (with new disks) as an archival tier.
[19:29] <snakamoto> did you run into any problems with the R730XDs, or the H730?
[19:29] <zw> So you just have 24 PE730's doing the job ... nice. What OS are you running ? Ubuntu ?
[19:30] <m0zes> snakamoto: if you raid your boot devices (via the raid card), no issue. if you use software raid, you can only make one of the ssds bootable.
[19:30] <m0zes> zw: CentOS 7.1
[19:30] * as0bu (~as0bu@c-98-230-203-84.hsd1.nm.comcast.net) has joined #ceph
[19:31] <zw> m0zes: any particular reason for that choice ? I thought I've read that ubuntu was the prefered choice. I could be wrong.
[19:31] <zw> m0zes: So you have 2 smaller disks for OS and two ssd's and 4TB disks in all other bays
[19:31] * marrusl (~mark@cpe-67-247-9-253.nyc.res.rr.com) Quit (Quit: bye!)
[19:32] <m0zes> inktank is owned by Redhat. Gentoo is my normally preferred distro. CentOS seemed like the lesser of two evils, compared to ubuntu ;)
[19:32] <m0zes> zw: 2 ssds for OS, 4x 4TB drives in the internal bays, 12x 6TB drives in the hot-swap bays.
[19:33] <zw> Ah :) What if one of the internal bays fail ?
[19:33] <zw> Just shut it down and replace it without downtime ?
[19:34] * ira (~ira@c-71-233-225-22.hsd1.ma.comcast.net) has joined #ceph
[19:34] <m0zes> we take the node offline. the cluster can run just fine with 1/4 of nodes down.
[19:34] <ska> doppelgrau: Is there any command that will show the MDS ip's ?
[19:34] <m0zes> ska: ceph mds stat ?
[19:35] <ska> yea.. Thanks.. dump works too.
[19:37] <snakamoto> m0zes, are the internal bays not hot swappable?
[19:39] <m0zes> snakamoto: they probably are, if you want to setup the cable management arms and make sure you can fully extend the chassis while leaving it powered up. I don't care for the blocked airflow of the arms.
[19:39] <m0zes> and I worry about bend radii of 40Gb ethernet cables.
[19:39] <snakamoto> yeah, we're seeing about +5/10F with the rails
[19:39] <snakamoto> dual 40Gb?
[19:40] <TheSov> pricing per system, it appears that supermicro is the bane of dell and hp
[19:41] <TheSov> i priced out a cluster from scratch, monitors, switches and systems, 430TB raw for 40k
[19:41] <TheSov> less than an equalogic node
[19:41] <m0zes> snakamoto: we've got dual port cards, we only have one connected at the moment.
[19:42] * Meths_ (~meths@2.25.223.245) has joined #ceph
[19:44] <essjayhch> 2.2PB isn't mahussive. We're running one at well over 6 as a starting point.
[19:44] <snakamoto> usable or raw?
[19:44] <essjayhch> usable. raw there is a little over 15
[19:45] <snakamoto> so you're using rack-level failure zones?
[19:45] * m0zes knows he isn't one of the big boys ;)
[19:45] <TheSov> how often do you find yourself deleting osd's due to failure at that scale?
[19:46] <essjayhch> indeed
[19:47] * Meths (~meths@2.25.223.20) Quit (Ping timeout: 480 seconds)
[19:49] <snakamoto> essjayhch: have you had any luck with the 'osd backfill full ratio' setting?
[19:49] <snakamoto> I'm concerned about a rack-level failure causing an OSD to reach full ratio
[19:50] * ira (~ira@c-71-233-225-22.hsd1.ma.comcast.net) Quit (Remote host closed the connection)
[19:50] * ChrisNBlum (~ChrisNBlu@dhcp-ip-217.dorf.rwth-aachen.de) Quit (Ping timeout: 480 seconds)
[19:51] * derjohn_mob (~aj@tmo-100-166.customers.d1-online.com) has joined #ceph
[19:51] <doppelgrau> snakamoto: limit automatic recovery to smaler parts? mon osd downout subtree limit = chassis
[19:53] * ChrisNBlum (~ChrisNBlu@dhcp-ip-217.dorf.rwth-aachen.de) has joined #ceph
[19:53] * georgem (~Adium@206.108.127.16) Quit (Quit: Leaving.)
[19:55] <snakamoto> doppelgrau: interesting, thank you. I'll have to run the math on that
[19:55] <nils_> I gotta say I prefer Supermicro
[19:56] * angdraug (~angdraug@12.164.168.117) has joined #ceph
[19:56] <nils_> as long as you keep spare parts
[19:57] <gleam> i hate supermicro's ipmi interface but the price is so cheap
[19:57] <gleam> that i don't care
[19:57] <m0zes> their remote console is buggy as heck.
[19:58] <m0zes> It crashes ~30% of the time within the first minute of using it.
[19:58] <rkeene> You'd think serial-console-over-IP would be really stable by now :-(
[19:58] <rkeene> I've never had a problem with it on any server I've worked with, but that doesn't include a lot of SuperMicros
[19:58] <m0zes> s/console/KVM/
[19:58] <rkeene> KVM ? For a server ?
[19:58] <rkeene> Who even puts video cards in a server ?
[19:59] <rkeene> I guess if you have a GPU-farm or something...
[19:59] <m0zes> on occasion it is easier to use that than getting serial console working in the os.
[19:59] * marrusl (~mark@cpe-67-247-9-253.nyc.res.rr.com) has joined #ceph
[19:59] <rkeene> ?
[20:00] <snakamoto> rkeene: sometimes we need to have remote hands hookup a crash cart to our servers
[20:00] <rkeene> snakamoto, Yeah, I've done that too ... minicom works great for that.
[20:00] <rkeene> For when some jerk fails to configure ILOM/ALOM/XSCF
[20:01] <m0zes> rkeene: the remote KVM, built-in to their ipmi controller. I think they call it iKVM or rKVM or something like that.
[20:01] <doppelgrau> snakamoto: The assumption is in my case: a rack failure (either switch or fuse-failure) is so grave someone is going to the DC asap => risk of other failures till repaired is low (and usually repair time < time to rebalance a whole rack)
[20:01] * brutuscat (~brutuscat@39.Red-83-47-149.dynamicIP.rima-tde.net) Quit (Read error: Connection reset by peer)
[20:02] <rkeene> m0zes, But if you're working on a server you definitely don't want Keyboard, Video, or Mouse -- you really want to send it data and get data back over the serial port
[20:03] <rkeene> None of my servers even have video cards... because they're servers and I'm not doing a GPU-farm
[20:05] <rkeene> I really didn't know people putting video cards in servers was a thing...
[20:07] * bitserker (~toni@88.87.194.130) Quit (Ping timeout: 480 seconds)
[20:16] * georgem (~Adium@206.108.127.16) has joined #ceph
[20:28] <snakamoto> doppelgrau: I feel the same way; it's not a situation that is going to be persistent, and not worth the risk of the extra load or the possibility of filling up an OSD.
[20:28] <snakamoto> Also, we're going with replication factor of 3.
[20:29] <doppelgrau> snakamoto: dito, size=2, min_size=2
[20:30] <doppelgrau> size=3, min_size=2
[20:30] <TheSov> size 2 is not safe
[20:30] * Ceph-Log-Bot (~logstash@185.66.248.215) has joined #ceph
[20:30] * Ceph-Log-Bot (~logstash@185.66.248.215) Quit (Read error: Connection reset by peer)
[20:31] <TheSov> if you lose an osd, there is a high probability the osds with the data copy will encounter URE's
[20:31] <doppelgrau> TheSov: size 3 isn???t safe either (although propability for data loss is way lower)
[20:31] <snakamoto> "two is one and one is none"
[20:31] <TheSov> snakamoto, indeed
[20:31] <snakamoto> doppelgrau: I joked about going with a factor of 4. No one laughed. :D
[20:32] <doppelgrau> snakamoto: I know someone who is planing with size=2, min_size=2 in a really large setup
[20:32] <TheSov> i would say size 3 is the lowest you should go
[20:32] <TheSov> doppelgrau, backups?
[20:33] <snakamoto> ouch, yeah sounds painful
[20:33] <doppelgrau> args, thick fingers today
[20:33] <doppelgrau> size 4
[20:33] <snakamoto> ahhh, much better
[20:34] <georgem> essjayhch: I'm curious, what's your use case? rbd? objects?
[20:34] <doppelgrau> snakamoto: their assumption is that the dc should be very low maintenance with failuredomain ???room??? and when a room fails a second failure shouldn???t lead to blocked IO during recovery ???
[20:34] <snakamoto> they've gotta either have a large public network, or a separate private network.
[20:34] <snakamoto> s/private/cluster
[20:35] <snakamoto> but wow, room level failure domains
[20:36] <doppelgrau> snakamoto: the contrast to ???our??? assumption of ???thats going to be fixed asap???, their assumption is ???we will eventually repair or replace failed systems???
[20:37] * ira (~ira@c-71-233-225-22.hsd1.ma.comcast.net) has joined #ceph
[20:37] * ngoswami (~ngoswami@121.244.87.116) Quit (Quit: Leaving)
[20:38] * gucki (~smuxi@p549F98A3.dip0.t-ipconnect.de) has joined #ceph
[20:38] * georgem (~Adium@206.108.127.16) Quit (Quit: Leaving.)
[20:38] <doppelgrau> snakamoto: ???if a room burns down and somewhere else fails something, the system should stay online???, that demand results in size=4 and room as failure domain
[20:39] * Miouge_ (~Miouge@91.178.40.52) has joined #ceph
[20:39] <doppelgrau> snakamoto: but yes, I said ???wow??? too when I was talking with one of the guys once
[20:39] * Miouge (~Miouge@91.178.33.59) Quit (Ping timeout: 480 seconds)
[20:39] * Miouge_ is now known as Miouge
[20:44] * wicope (~wicope@0001fd8a.user.oftc.net) has joined #ceph
[20:46] * georgem (~Adium@206.108.127.16) has joined #ceph
[20:48] * nardial (~ls@dslb-178-006-188-098.178.006.pools.vodafone-ip.de) has joined #ceph
[20:52] * nardial (~ls@dslb-178-006-188-098.178.006.pools.vodafone-ip.de) Quit (Remote host closed the connection)
[20:53] * nardial (~ls@dslb-178-006-188-098.178.006.pools.vodafone-ip.de) has joined #ceph
[20:53] * derjohn_mob (~aj@tmo-100-166.customers.d1-online.com) Quit (Ping timeout: 480 seconds)
[20:55] * ircolle (~Adium@2601:285:201:2bf9:7998:332f:4c2b:a5be) Quit (Quit: Leaving.)
[20:57] * nardial (~ls@dslb-178-006-188-098.178.006.pools.vodafone-ip.de) Quit ()
[20:58] * Miouge (~Miouge@91.178.40.52) Quit (Quit: Miouge)
[21:09] * Meths_ is now known as Meths
[21:10] * zw (~wesley@spider.pfoe.be) Quit (Quit: Lost terminal)
[21:12] * dopesong (~dopesong@78-60-74-130.static.zebra.lt) has joined #ceph
[21:12] * marrusl (~mark@cpe-67-247-9-253.nyc.res.rr.com) Quit (Remote host closed the connection)
[21:14] * marrusl (~mark@cpe-67-247-9-253.nyc.res.rr.com) has joined #ceph
[21:17] * nsoffer (~nsoffer@bzq-79-177-255-219.red.bezeqint.net) has joined #ceph
[21:17] <imcsk8> hello my ceph health returns this: HEALTH_WARN 44 pgs degraded; 44 pgs stuck degraded; 64 pgs stuck unclean; 44 pgs stuck undersized; 44 pgs undersized; recovery 623366/2721633 objects degraded (22.904%); recovery 283863/2721633 objects misplaced (10.430%) what should be the better course of action? ceph pg dump_stuck stale/inactive/unclean ??
[21:17] * sjm (~sjm@pool-100-1-115-73.nwrknj.fios.verizon.net) has left #ceph
[21:18] * s3an2 (~root@korn.s3an.me.uk) Quit (Quit: Changing server)
[21:18] * dopesong_ (~dopesong@lb1.mailer.data.lt) has joined #ceph
[21:21] * dopesong (~dopesong@78-60-74-130.static.zebra.lt) Quit (Ping timeout: 480 seconds)
[21:26] <TheSov> http://www.newegg.com/Product/Product.aspx?Item=N82E16813157419 - wow. i found my new osd servers
[21:26] <nils_> TheSov: getting a separate NIC?
[21:27] <TheSov> 8x slot man, thats a 10 gig nic right there
[21:27] * lxo (~aoliva@lxo.user.oftc.net) Quit (Quit: later)
[21:27] <monsted> TheSov: you can have them with even more disk ports :)
[21:27] <TheSov> not enough cpu at that point
[21:27] <TheSov> these are 8 core
[21:27] <nils_> the problem is you'll run out of PCIe lanes as well
[21:27] <TheSov> 1 core per osd :)
[21:28] <monsted> TheSov: nope, c2550 is quad, not octo
[21:28] <nils_> Asrock Rack are going to release Xeon-D boards next month
[21:28] <nils_> but it's probably in the $1000 range
[21:28] <TheSov> oh crap
[21:28] * dneary_ (~dneary@AGrenoble-651-1-600-61.w90-52.abo.wanadoo.fr) Quit (Ping timeout: 480 seconds)
[21:28] <TheSov> i need the 2700 series
[21:28] <monsted> TheSov: you're thinking of the 2750
[21:28] <TheSov> http://www.newegg.com/Product/Product.aspx?Item=N82E16813157475
[21:29] <TheSov> 100 dollars difference...
[21:29] <TheSov> wow
[21:29] * thomnico (~thomnico@cro38-2-88-180-16-18.fbx.proxad.net) Quit (Ping timeout: 480 seconds)
[21:29] <monsted> still nice. IPMI, 8 cores, extremely low power and lots of SATA ports.
[21:30] * arbrandes (~arbrandes@179.210.13.90) Quit (Remote host closed the connection)
[21:30] <TheSov> hmm need a case
[21:30] <monsted> https://www.asus.com/us/Commercial_Servers_Workstations/P9AIC2750SAS4L/ has 16x SAS and 2x SATA
[21:30] <monsted> but unfortunately some crappy marvell SAS chips
[21:32] <TheSov> so a 2750 mobo, 8 wd red 6tb disks and 32gb ram is 2700 bucks and no case yet
[21:32] <TheSov> looking for a case
[21:33] <TheSov> http://www.newegg.com/Product/Product.aspx?Item=N82E16811192386
[21:33] <TheSov> ok so 8 osds. 3k
[21:33] <TheSov> vs 24osds for 10k
[21:34] <TheSov> the 10k one barely wins, but 24 osds per machine is still cheaper
[21:35] <m0zes> more memory.
[21:35] <TheSov> but not by much
[21:35] <monsted> the $10k box might be better built, though
[21:35] <TheSov> it is
[21:35] <m0zes> at least 1GB/TB
[21:35] <TheSov> its a super micro
[21:36] <TheSov> i got a nic pricing spreadsheet here
[21:36] <TheSov> cluster from scratch with just 1 osd server and switches for front and backend is 19,275.00
[21:37] <TheSov> it gives you 144tb raw
[21:37] <TheSov> from there every additional 144tb is only 10k
[21:37] * Miouge (~Miouge@91.178.40.52) has joined #ceph
[21:38] <TheSov> forgot to say 3 monitors
[21:38] <TheSov> has anyone here used ip over infiniband for ceph?
[21:38] <TheSov> it seems much cheaper than 10gig for now
[21:39] <nils_> IPoIB?
[21:39] <TheSov> yes
[21:39] * Sysadmin88 (~IceChat77@05453139.skybroadband.com) has joined #ceph
[21:39] <nils_> I think you can even switch the Mellanox cards to Ethernet Operation if IB doesn't work out
[21:39] <TheSov> i hear its really hit or miss
[21:40] <TheSov> you can they use SFP ports
[21:40] <nils_> last time I used IB was with DRBD
[21:40] <nils_> QSFP more likely...
[21:40] <nils_> at least for FDR/QDR
[21:40] <nils_> sadly the drivers are atrocious
[21:41] <nils_> you basically have to use an out of kernel tree which is usually only compatible with the ancient kernels from RHEL
[21:42] * rendar (~I@host57-176-dynamic.55-79-r.retail.telecomitalia.it) Quit (Ping timeout: 480 seconds)
[21:42] * rotbeard (~redbeard@2a02:908:df10:d300:76f0:6dff:fe3b:994d) has joined #ceph
[21:45] * rendar (~I@host57-176-dynamic.55-79-r.retail.telecomitalia.it) has joined #ceph
[21:47] * Miouge (~Miouge@91.178.40.52) Quit (Quit: Miouge)
[21:47] <TheSov> crap
[21:47] * georgem (~Adium@206.108.127.16) Quit (Quit: Leaving.)
[21:47] * georgem (~Adium@206.108.127.16) has joined #ceph
[21:49] <TheSov> ciena
[21:50] <TheSov> they make some nice switches
[21:51] * georgem (~Adium@206.108.127.16) has left #ceph
[21:51] * wer (~wer@206-248-239-142.unassigned.ntelos.net) Quit (Remote host closed the connection)
[21:54] <m0zes> mlx4 and mthca drivers are in-kernel.
[21:54] <m0zes> mlx4_en and mlx4_ib work great. It is all I use, after getting pissed off at intel, broadcom, and q-logic.
[21:55] <ska> Can I run several clusters on the same set of Monitors?
[21:55] * wer (~wer@206-248-239-142.unassigned.ntelos.net) has joined #ceph
[21:56] <snakamoto> ska: I haven't seen anyone do it in the past 8 months.
[21:56] <nils_> no chelsio?
[21:56] <nils_> m0zes: and you don't use the mellanox OFED distribution?
[21:56] <snakamoto> Seems like a bad idea if they're sharing the volume for their leveldbs
[21:56] <ska> ok, docs say you can run multple clustes on the same hardware, but perhaps the mon will have a unique process per cluster.
[21:56] <m0zes> nils_: nope.
[21:57] <nils_> I would actually prefer infiniband for latency reasons
[21:58] <TheSov> nils_, ip over infiniband is more latent
[21:58] <m0zes> "normal" ofed works fine with the mellanox cards. I know mellanox ofed has some fixes for somethings, but it isn't worth it to run old kernels, or platform specific codes...
[21:58] <snakamoto> ska: you're right, says different ports for additional monitor processes
[21:59] <ska> I was reading: http://ceph.com/docs/master/rados/configuration/mon-config-ref/ and it was confusing..
[21:59] <ska> snakamoto: So I putting the MON at the super-cluster level instead of sub-cluster in my toy-model.
[22:00] <snakamoto> the mon server
[22:00] <ska> snakamoto: but is it the same process that is listening on different ports?
[22:01] <snakamoto> I'm only guessing, but it's gotta be different processes
[22:01] <snakamoto> because you would need to have separate <cluster>.conf file for each cluster
[22:01] * ira (~ira@c-71-233-225-22.hsd1.ma.comcast.net) Quit (Ping timeout: 480 seconds)
[22:02] * Ceph-Log-Bot (~logstash@185.66.248.215) has joined #ceph
[22:02] * Ceph-Log-Bot (~logstash@185.66.248.215) Quit (Read error: Connection reset by peer)
[22:02] * Miouge (~Miouge@91.178.40.52) has joined #ceph
[22:02] * Miouge (~Miouge@91.178.40.52) Quit ()
[22:04] * dopesong_ (~dopesong@lb1.mailer.data.lt) Quit (Remote host closed the connection)
[22:04] * jwilkins (~jwilkins@2601:644:4100:bfef:ea2a:eaff:fe08:3f1d) has joined #ceph
[22:07] * derjohn_mob (~aj@x4db016e1.dyn.telefonica.de) has joined #ceph
[22:14] <ska> If anyone runs multiple clusters on same Mon, please let me know.. I need some sample data.
[22:14] * gucki (~smuxi@p549F98A3.dip0.t-ipconnect.de) Quit (Ping timeout: 480 seconds)
[22:14] * alfredodeza (~alfredode@198.206.133.89) has left #ceph
[22:14] * linjan (~linjan@176.195.217.90) has joined #ceph
[22:15] * nsoffer (~nsoffer@bzq-79-177-255-219.red.bezeqint.net) Quit (Ping timeout: 480 seconds)
[22:17] * ira (~ira@c-71-233-225-22.hsd1.ma.comcast.net) has joined #ceph
[22:25] <doppelgrau> what could be a good reason to run multiple clusters with common monitors (maybe expect having multiple cephfs Filesystems)
[22:27] <nils_> it seems that in some cases btrfs will return EIO on safe_pread() even though deep scrub and btrfs scrub don't show any errors (nor any S.M.A.R.T. errors or I/O errors)
[22:29] * reinhardt1053 (~reinhardt@185.40.62.171) has joined #ceph
[22:32] * nsoffer (~nsoffer@85-250-77-46.bb.netvision.net.il) has joined #ceph
[22:33] * jacoo (~TheDoudou@h-213.61.149.100.host.de.colt.net) has joined #ceph
[22:38] * sleinen (~Adium@84-72-160-233.dclient.hispeed.ch) has joined #ceph
[22:38] * badone (~brad@CPE-121-215-241-179.static.qld.bigpond.net.au) has joined #ceph
[22:38] * c4tech (~c4tech@199.91.185.156) has joined #ceph
[22:38] * ganders (~root@190.2.42.21) Quit (Quit: WeeChat 0.4.2)
[22:38] * stiopa (~stiopa@cpc73828-dals21-2-0-cust630.20-2.cable.virginm.net) has joined #ceph
[22:39] * TheSov (~TheSov@204.13.200.248) Quit (Quit: Leaving)
[22:39] * sleinen1 (~Adium@2001:620:0:69::100) has joined #ceph
[22:42] <c4tech> I installed a new radosgw and I'm getting this error. 0 ERROR: can't get key: ret=-2
[22:42] <c4tech> Could somone please tell me if I should worry about this?
[22:46] * sleinen (~Adium@84-72-160-233.dclient.hispeed.ch) Quit (Ping timeout: 480 seconds)
[22:48] * Destreyf (~quassel@email.newagecomputers.info) has joined #ceph
[22:48] * jwilkins (~jwilkins@2601:644:4100:bfef:ea2a:eaff:fe08:3f1d) Quit (Ping timeout: 480 seconds)
[23:00] * jwilkins (~jwilkins@c-67-180-123-48.hsd1.ca.comcast.net) has joined #ceph
[23:02] * jacoo (~TheDoudou@9S0AACMM6.tor-irc.dnsbl.oftc.net) Quit ()
[23:03] * tupper (~tcole@173.38.117.72) Quit (Ping timeout: 480 seconds)
[23:04] * nils_ (~nils@doomstreet.collins.kg) Quit (Quit: This computer has gone to sleep)
[23:04] * Ceph-Log-Bot (~logstash@185.66.248.215) has joined #ceph
[23:04] * Ceph-Log-Bot (~logstash@185.66.248.215) Quit (Read error: Connection reset by peer)
[23:06] <badone> c4tech: ENOENT 2 /* No such file or directory */
[23:06] <badone> c4tech: missing key?
[23:09] * nsoffer (~nsoffer@85-250-77-46.bb.netvision.net.il) Quit (Ping timeout: 480 seconds)
[23:10] * thomnico (~thomnico@2a01:e35:8b41:120:cdbb:6d6c:1450:cf42) has joined #ceph
[23:12] * marrusl (~mark@cpe-67-247-9-253.nyc.res.rr.com) Quit (Quit: bye!)
[23:18] * marrusl (~mark@cpe-67-247-9-253.nyc.res.rr.com) has joined #ceph
[23:23] * thomnico (~thomnico@2a01:e35:8b41:120:cdbb:6d6c:1450:cf42) Quit (Quit: Ex-Chat)
[23:23] * thomnico (~thomnico@2a01:e35:8b41:120:cdbb:6d6c:1450:cf42) has joined #ceph
[23:27] * noferrets (~noferrets@host86-140-149-12.range86-140.btcentralplus.com) Quit (Ping timeout: 480 seconds)
[23:34] * rlrevell (~leer@vbo1.inmotionhosting.com) Quit (Ping timeout: 480 seconds)
[23:36] * capri_oner (~capri@212.218.127.222) has joined #ceph
[23:36] * doppelgrau_ (~doppelgra@pd956d116.dip0.t-ipconnect.de) has joined #ceph
[23:39] * PcJamesy (~nicatronT@tor-exit-node.7by7.de) has joined #ceph
[23:41] * doppelgrau (~doppelgra@pd956d116.dip0.t-ipconnect.de) Quit (Ping timeout: 480 seconds)
[23:41] * doppelgrau_ is now known as doppelgrau
[23:42] * capri_on (~capri@212.218.127.222) Quit (Ping timeout: 480 seconds)
[23:43] * alfredodeza (~alfredode@198.206.133.89) has joined #ceph
[23:44] * fridim_ (~fridim@56-198-190-109.dsl.ovh.fr) Quit (Ping timeout: 480 seconds)
[23:45] * thomnico (~thomnico@2a01:e35:8b41:120:cdbb:6d6c:1450:cf42) Quit (Ping timeout: 480 seconds)
[23:45] * sleinen1 (~Adium@2001:620:0:69::100) Quit (Ping timeout: 480 seconds)
[23:47] * lpabon (~quassel@24-151-54-34.dhcp.nwtn.ct.charter.com) Quit (Ping timeout: 480 seconds)
[23:51] * brad_mssw|work (~brad@66.129.88.50) has joined #ceph
[23:52] * brad_mssw (~brad@66.129.88.50) Quit (Ping timeout: 480 seconds)
[23:54] * Concubidated (~Adium@161.225.196.30) Quit (Quit: Leaving.)
[23:58] * doppelgrau (~doppelgra@pd956d116.dip0.t-ipconnect.de) Quit (Quit: doppelgrau)
[23:59] * linjan (~linjan@176.195.217.90) Quit (Ping timeout: 480 seconds)

These logs were automatically created by CephLogBot on irc.oftc.net using the Java IRC LogBot.