#ceph IRC Log

Index

IRC Log for 2015-03-02

Timestamps are in GMT/BST.

[0:01] <flaf> Hi, I'm looking for a way to reboot a node of a ceph cluster so as to minimize the impact on ceph clients.
[0:01] <flaf> My problem is just when the node contains the *active* mds service.
[0:01] <flaf> If I stop this (active) mds service (stop ceph-mds-all), in the client side, during ~20 seconds the cephfs storage is stalled and waits for a mds service in another node swithes from standby to active.
[0:02] <flaf> Do you know a faster way to force the switch of active mds service from node1 to node2?
[0:06] * fghaas (~florian@46-253-188-146.dynamic.monzoon.net) Quit (Quit: Leaving.)
[0:12] * wschulze (~wschulze@cpe-69-206-251-158.nyc.res.rr.com) has joined #ceph
[0:17] <flaf> (I use firefly one ubuntu trusty)
[0:18] * diegows (~diegows@190.190.5.238) has joined #ceph
[0:20] * colde1 (~Zeis@7KUAAA69W.tor-irc.dnsbl.oftc.net) Quit ()
[0:21] * elder_ (~elder@c-24-245-18-91.hsd1.mn.comcast.net) has joined #ceph
[0:24] * wschulze (~wschulze@cpe-69-206-251-158.nyc.res.rr.com) Quit (Quit: Leaving.)
[0:33] * KevinPerks (~Adium@cpe-071-071-026-213.triad.res.rr.com) Quit (Quit: Leaving.)
[0:46] <flaf> Oh, sorry for the noise. It's in the doc http://ceph.com/docs/master/rados/operations/control/#mds-subsystem
[0:47] <flaf> -> ceph mds fail 0
[0:48] <flaf> (0 is not the id of the mds service, even if a active mds is id=3, it seems that the command is still "ceph mds fail 0")
[0:49] <flaf> With this command, I have a freeze during ~3.5 seconds. That's better. :)
[0:57] * drupal (~spate@1CIAAGYFU.tor-irc.dnsbl.oftc.net) has joined #ceph
[0:58] * treaki (~treaki@p5B031148.dip0.t-ipconnect.de) Quit (Ping timeout: 480 seconds)
[1:01] * ChrisNBlum (~ChrisNBlu@dhcp-ip-230.dorf.rwth-aachen.de) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[1:01] * zack_dolby (~textual@nfmv001075087.uqw.ppp.infoweb.ne.jp) has joined #ceph
[1:03] * treaki (~treaki@p5B031148.dip0.t-ipconnect.de) has joined #ceph
[1:04] * chasmo77 (~chas77@158.183-62-69.ftth.swbr.surewest.net) Quit (Quit: It's just that easy)
[1:07] * delatte (~cdelatte@204-235-114.160.twcable.com) has joined #ceph
[1:14] * delattec (~cdelatte@cpe-075-176-084-224.carolina.res.rr.com) Quit (Ping timeout: 480 seconds)
[1:20] * i_m (~ivan.miro@nat-5-carp.hcn-strela.ru) Quit (Ping timeout: 480 seconds)
[1:25] * drupal (~spate@1CIAAGYFU.tor-irc.dnsbl.oftc.net) Quit ()
[1:25] * SweetGirl (~dontron@manning2.torservers.net) has joined #ceph
[1:26] * macjack (~Thunderbi@123.51.160.200) has joined #ceph
[1:31] * wschulze (~wschulze@cpe-69-206-251-158.nyc.res.rr.com) has joined #ceph
[1:39] * badone (~brad@CPE-121-215-241-179.static.qld.bigpond.net.au) Quit (Ping timeout: 480 seconds)
[1:44] * lucas1 (~Thunderbi@218.76.52.64) has joined #ceph
[1:46] * shyu (~Shanzhi@119.254.196.66) has joined #ceph
[1:51] * hasues (~hazuez@108-236-232-243.lightspeed.knvltn.sbcglobal.net) has joined #ceph
[1:51] * lucas1 (~Thunderbi@218.76.52.64) Quit (Remote host closed the connection)
[1:54] * hasues (~hazuez@108-236-232-243.lightspeed.knvltn.sbcglobal.net) has left #ceph
[1:55] * SweetGirl (~dontron@3N2AABHZS.tor-irc.dnsbl.oftc.net) Quit ()
[1:55] * Popz (~sese_@tor-amici-exit.tritn.com) has joined #ceph
[1:57] * sputnik13 (~sputnik13@110.sub-70-199-145.myvzw.com) Quit (Quit: My MacBook has gone to sleep. ZZZzzz???)
[2:01] * dalgaaf (uid15138@id-15138.charlton.irccloud.com) has joined #ceph
[2:08] * sputnik13 (~sputnik13@110.sub-70-199-145.myvzw.com) has joined #ceph
[2:08] * kefu (~kefu@114.92.100.153) has joined #ceph
[2:12] * LeaChim (~LeaChim@host86-159-234-113.range86-159.btcentralplus.com) Quit (Ping timeout: 480 seconds)
[2:12] * kefu (~kefu@114.92.100.153) Quit ()
[2:17] * Manshoon (~Manshoon@c-50-181-29-219.hsd1.wv.comcast.net) Quit (Remote host closed the connection)
[2:18] * sputnik13 (~sputnik13@110.sub-70-199-145.myvzw.com) Quit (Quit: My MacBook has gone to sleep. ZZZzzz???)
[2:22] * KevinPerks (~Adium@cpe-071-071-026-213.triad.res.rr.com) has joined #ceph
[2:22] * sputnik13 (~sputnik13@110.sub-70-199-145.myvzw.com) has joined #ceph
[2:25] * Popz (~sese_@1CIAAGYHO.tor-irc.dnsbl.oftc.net) Quit ()
[2:25] * Tumm (~jwandborg@tor-exit-node-2.cs.usu.edu) has joined #ceph
[2:25] * sputnik13 (~sputnik13@110.sub-70-199-145.myvzw.com) Quit ()
[2:30] * kefu (~kefu@114.92.100.153) has joined #ceph
[2:47] * sputnik13 (~sputnik13@110.sub-70-199-145.myvzw.com) has joined #ceph
[2:55] * Tumm (~jwandborg@2BLAAF2A0.tor-irc.dnsbl.oftc.net) Quit ()
[2:55] * rcfighter (~Fapiko@c-24-12-250-200.hsd1.il.comcast.net) has joined #ceph
[3:02] * danieagle (~Daniel@201-95-100-195.dsl.telesp.net.br) Quit (Quit: Obrigado por Tudo! :-) inte+ :-))
[3:10] * diegows (~diegows@190.190.5.238) Quit (Ping timeout: 480 seconds)
[3:17] * lightspeed (~lightspee@2001:8b0:16e:1:8326:6f70:89f:8f9c) Quit (Ping timeout: 480 seconds)
[3:25] * rcfighter (~Fapiko@1CIAAGYJF.tor-irc.dnsbl.oftc.net) Quit ()
[3:25] * Wizeon (~Kottizen@manning1.torservers.net) has joined #ceph
[3:25] * lightspeed (~lightspee@2001:8b0:16e:1:8326:6f70:89f:8f9c) has joined #ceph
[3:39] * vbellur (~vijay@122.167.86.184) has joined #ceph
[3:55] * Wizeon (~Kottizen@7KUAAA7FG.tor-irc.dnsbl.oftc.net) Quit ()
[3:59] * homosaur (~Kyso@tor-exit0-readme.dfri.se) has joined #ceph
[4:00] * jks (~jks@178.155.151.121) Quit (Read error: Connection reset by peer)
[4:00] * jks (~jks@178.155.151.121) has joined #ceph
[4:01] * kefu (~kefu@114.92.100.153) Quit (Max SendQ exceeded)
[4:17] * vbellur (~vijay@122.167.86.184) Quit (Ping timeout: 480 seconds)
[4:17] * lx0 (~aoliva@lxo.user.oftc.net) Quit (Remote host closed the connection)
[4:17] * lx0 (~aoliva@lxo.user.oftc.net) has joined #ceph
[4:18] * Manshoon (~Manshoon@c-50-181-29-219.hsd1.wv.comcast.net) has joined #ceph
[4:26] * Manshoon (~Manshoon@c-50-181-29-219.hsd1.wv.comcast.net) Quit (Ping timeout: 480 seconds)
[4:29] * homosaur (~Kyso@1QYAABDCY.tor-irc.dnsbl.oftc.net) Quit ()
[4:29] * vbellur (~vijay@122.178.249.87) has joined #ceph
[4:30] * _303 (~MKoR@euserv4-10.rana.at) has joined #ceph
[4:39] * zhaochao (~zhaochao@123.125.35.145) has joined #ceph
[4:59] * _303 (~MKoR@1CIAAGYMW.tor-irc.dnsbl.oftc.net) Quit ()
[5:00] * aleksag (~Gecko1986@tor-exit.kakapo.dk) has joined #ceph
[5:01] * xarses_ (~andreww@c-76-126-112-92.hsd1.ca.comcast.net) has joined #ceph
[5:03] * rpb (~rpb@199.68.195.102) Quit (Ping timeout: 480 seconds)
[5:17] * vbellur (~vijay@122.178.249.87) Quit (Ping timeout: 480 seconds)
[5:29] * aleksag (~Gecko1986@2BLAAF2DX.tor-irc.dnsbl.oftc.net) Quit ()
[5:30] * Rens2Sea (~bret@192.99.250.143) has joined #ceph
[5:31] * Vacuum_ (~vovo@88.130.214.149) has joined #ceph
[5:31] * badone (~brad@CPE-121-215-241-179.static.qld.bigpond.net.au) has joined #ceph
[5:32] * amote (~amote@121.244.87.116) has joined #ceph
[5:38] * Vacuum (~vovo@i59F79184.versanet.de) Quit (Ping timeout: 480 seconds)
[5:47] * dalgaaf (uid15138@id-15138.charlton.irccloud.com) Quit (Quit: Connection closed for inactivity)
[5:59] * Rens2Sea (~bret@1CIAAGYO3.tor-irc.dnsbl.oftc.net) Quit ()
[6:05] * sputnik13 (~sputnik13@110.sub-70-199-145.myvzw.com) Quit (Quit: My MacBook has gone to sleep. ZZZzzz???)
[6:09] * rdas (~rdas@121.244.87.116) has joined #ceph
[6:30] * segutier (~segutier@67.164.47.206) has joined #ceph
[6:31] * wschulze (~wschulze@cpe-69-206-251-158.nyc.res.rr.com) Quit (Quit: Leaving.)
[6:36] * isaxi (~uhtr5r@kiriakou.tor-exit.calyxinstitute.org) has joined #ceph
[6:38] * carter (~carter@li98-136.members.linode.com) Quit (Quit: ZNC - http://znc.in)
[6:39] * vbellur (~vijay@121.244.87.117) has joined #ceph
[6:39] * carter (~carter@li98-136.members.linode.com) has joined #ceph
[6:45] * segutier (~segutier@67.164.47.206) Quit (Quit: segutier)
[6:46] * derjohn_mobi (~aj@ip-95-223-126-17.hsi16.unitymediagroup.de) Quit (Ping timeout: 480 seconds)
[6:48] * overclk (~overclk@121.244.87.117) has joined #ceph
[6:52] * hasues (~hazuez@66.87.153.242) has joined #ceph
[6:52] * segutier (~segutier@67.164.47.206) has joined #ceph
[6:58] * sputnik13 (~sputnik13@c-73-193-97-20.hsd1.wa.comcast.net) has joined #ceph
[7:00] * hasues (~hazuez@66.87.153.242) Quit (Ping timeout: 480 seconds)
[7:00] * segutier (~segutier@67.164.47.206) Quit (Ping timeout: 480 seconds)
[7:01] * sputnik1_ (~sputnik13@c-73-193-97-20.hsd1.wa.comcast.net) has joined #ceph
[7:02] * fghaas (~florian@46-253-188-146.dynamic.monzoon.net) has joined #ceph
[7:04] * sputnik__ (~sputnik13@c-73-193-97-20.hsd1.wa.comcast.net) has joined #ceph
[7:05] * isaxi (~uhtr5r@3N2AABH77.tor-irc.dnsbl.oftc.net) Quit ()
[7:06] * sputnik13 (~sputnik13@c-73-193-97-20.hsd1.wa.comcast.net) Quit (Ping timeout: 480 seconds)
[7:06] * Jase (~Mraedis@tor.metaether.net) has joined #ceph
[7:10] * sputnik1_ (~sputnik13@c-73-193-97-20.hsd1.wa.comcast.net) Quit (Ping timeout: 480 seconds)
[7:11] * hasues (~hazuez@66.87.153.242) has joined #ceph
[7:11] * hasues (~hazuez@66.87.153.242) has left #ceph
[7:15] * kefu (~kefu@114.92.100.153) has joined #ceph
[7:17] * cookednoodles (~eoin@89-93-153-201.hfc.dyn.abo.bbox.fr) has joined #ceph
[7:21] * jclm (~jclm@uconference.fw.utas.edu.au) Quit (Quit: Leaving.)
[7:21] * capri (~capri@212.218.127.222) Quit (Ping timeout: 480 seconds)
[7:26] * segutier (~segutier@67.164.47.206) has joined #ceph
[7:31] * swami1 (~swami@49.32.0.191) has joined #ceph
[7:35] * Jase (~Mraedis@1CIAAGYS2.tor-irc.dnsbl.oftc.net) Quit ()
[7:35] * hoopy (~ggg@tor2.aurka.com) has joined #ceph
[7:41] * MACscr1 (~Adium@2601:d:c800:de3:1d3f:4e57:9707:893) has joined #ceph
[7:45] * zack_dol_ (~textual@nfmv001075087.uqw.ppp.infoweb.ne.jp) has joined #ceph
[7:45] * zack_dolby (~textual@nfmv001075087.uqw.ppp.infoweb.ne.jp) Quit (Read error: Connection reset by peer)
[7:46] * derjohn_mobi (~aj@88.128.80.196) has joined #ceph
[7:47] * MACscr (~Adium@2601:d:c800:de3:f16a:1bac:e865:7d57) Quit (Ping timeout: 480 seconds)
[7:48] * segutier (~segutier@67.164.47.206) Quit (Quit: segutier)
[7:48] * capri (~capri@212.218.127.222) has joined #ceph
[7:51] * lx0 (~aoliva@lxo.user.oftc.net) Quit (Ping timeout: 480 seconds)
[7:55] * yanzheng (~zhyan@182.149.64.145) has joined #ceph
[7:58] * KevinPerks (~Adium@cpe-071-071-026-213.triad.res.rr.com) Quit (Quit: Leaving.)
[7:58] * fghaas (~florian@46-253-188-146.dynamic.monzoon.net) Quit (Quit: Leaving.)
[8:00] * vbellur (~vijay@121.244.87.117) Quit (Ping timeout: 480 seconds)
[8:00] * Manshoon (~Manshoon@c-50-181-29-219.hsd1.wv.comcast.net) has joined #ceph
[8:00] * b0e (~aledermue@213.95.25.82) has joined #ceph
[8:02] * i_m (~ivan.miro@nat-5-carp.hcn-strela.ru) has joined #ceph
[8:02] * lxo (~aoliva@lxo.user.oftc.net) has joined #ceph
[8:05] * hoopy (~ggg@1CIAAGYT7.tor-irc.dnsbl.oftc.net) Quit ()
[8:05] * AotC (~Dragonsha@mc-wafflecraft.co.uk) has joined #ceph
[8:08] * Manshoon (~Manshoon@c-50-181-29-219.hsd1.wv.comcast.net) Quit (Ping timeout: 480 seconds)
[8:12] * cookednoodles (~eoin@89-93-153-201.hfc.dyn.abo.bbox.fr) Quit (Quit: Ex-Chat)
[8:13] * yanzheng (~zhyan@182.149.64.145) Quit (Quit: This computer has gone to sleep)
[8:15] * oro (~oro@80-219-254-208.dclient.hispeed.ch) has joined #ceph
[8:18] * Nacer (~Nacer@2001:41d0:fe82:7200:d03b:2462:dad1:b4f5) has joined #ceph
[8:19] * vbellur (~vijay@121.244.87.124) has joined #ceph
[8:21] * lalatenduM (~lalatendu@121.244.87.117) has joined #ceph
[8:21] * Sysadmin88 (~IceChat77@2.125.213.8) Quit (Quit: For Sale: Parachute. Only used once, never opened, small stain.)
[8:26] * derjohn_mobi (~aj@88.128.80.196) Quit (Ping timeout: 480 seconds)
[8:29] * cok (~chk@2a02:2350:18:1010:8cef:2751:40b4:b2c4) has joined #ceph
[8:35] * AotC (~Dragonsha@3N2AABIA1.tor-irc.dnsbl.oftc.net) Quit ()
[8:37] * Nacer (~Nacer@2001:41d0:fe82:7200:d03b:2462:dad1:b4f5) Quit (Remote host closed the connection)
[8:38] * rotbeard (~redbeard@b2b-94-79-138-170.unitymedia.biz) has joined #ceph
[8:45] * Bobby (~Random@5.135.85.23) has joined #ceph
[8:46] * Miouge (~Miouge@94.136.92.20) has joined #ceph
[8:49] * chasmo77 (~chas77@158.183-62-69.ftth.swbr.surewest.net) has joined #ceph
[8:51] * oro (~oro@80-219-254-208.dclient.hispeed.ch) Quit (Ping timeout: 480 seconds)
[8:51] * ade (~abradshaw@dslb-178-008-143-060.178.008.pools.vodafone-ip.de) has joined #ceph
[8:56] * thb (~me@0001bd58.user.oftc.net) has joined #ceph
[8:59] * rdas (~rdas@121.244.87.116) Quit (Quit: Leaving)
[9:15] * derjohn_mobi (~aj@fw.gkh-setu.de) has joined #ceph
[9:15] * Bobby (~Random@1CIAAGYXS.tor-irc.dnsbl.oftc.net) Quit ()
[9:16] * Thayli (~hifi@politkovskaja.torservers.net) has joined #ceph
[9:17] * TMM (~hp@178-84-46-106.dynamic.upc.nl) Quit (Quit: Ex-Chat)
[9:20] * ade (~abradshaw@dslb-178-008-143-060.178.008.pools.vodafone-ip.de) Quit (Quit: Too sexy for his shirt)
[9:22] * Be-El (~quassel@fb08-bcf-pc01.computational.bio.uni-giessen.de) has joined #ceph
[9:22] <Be-El> hi
[9:23] * Nacer (~Nacer@252-87-190-213.intermediasud.com) has joined #ceph
[9:27] * andreask (~andreask@2001:67c:1933:800::3200) has joined #ceph
[9:27] * ChanServ sets mode +v andreask
[9:32] * dgurtner (~dgurtner@178.197.231.49) has joined #ceph
[9:32] * jtang (~jtang@109.255.42.21) has joined #ceph
[9:32] * fsimonce (~simon@host217-37-dynamic.30-79-r.retail.telecomitalia.it) has joined #ceph
[9:35] * codice_ (~toodles@97-94-175-73.static.mtpk.ca.charter.com) Quit (Ping timeout: 480 seconds)
[9:35] * kawa2014 (~kawa@89.184.114.246) has joined #ceph
[9:39] * vbellur (~vijay@121.244.87.124) Quit (Ping timeout: 480 seconds)
[9:41] * ramonskie (ab15507e@107.161.19.109) has joined #ceph
[9:42] <ramonskie> hi i have a few incomplete pgs and the status is "down_osds_we_would_probe": [7]," but i already set that osd to lost and even removed it
[9:45] * Thayli (~hifi@1CIAAGYZI.tor-irc.dnsbl.oftc.net) Quit ()
[9:45] * Esge (~anadrom@tor-elpresidente.piraten-nds.de) has joined #ceph
[9:48] * oro (~oro@2001:620:20:16:384d:2075:2e42:8433) has joined #ceph
[9:51] * vbellur (~vijay@121.244.87.117) has joined #ceph
[9:54] <SamYaple> hello Be-El
[9:55] * cok (~chk@2a02:2350:18:1010:8cef:2751:40b4:b2c4) Quit (Quit: Leaving.)
[9:55] * rotbeard (~redbeard@b2b-94-79-138-170.unitymedia.biz) Quit (Quit: Leaving)
[9:58] * zack_dol_ (~textual@nfmv001075087.uqw.ppp.infoweb.ne.jp) Quit (Quit: My MacBook has gone to sleep. ZZZzzz???)
[10:03] * bkopilov (~bkopilov@bzq-109-65-184-239.red.bezeqint.net) Quit (Ping timeout: 480 seconds)
[10:03] * bkopilov (~bkopilov@bzq-109-65-111-90.red.bezeqint.net) has joined #ceph
[10:05] * sputnik__ (~sputnik13@c-73-193-97-20.hsd1.wa.comcast.net) Quit (Quit: My MacBook has gone to sleep. ZZZzzz???)
[10:06] * linjan (~linjan@195.110.41.9) has joined #ceph
[10:07] * branto (~branto@ip-213-220-214-203.net.upcbroadband.cz) has joined #ceph
[10:10] * ngoswami (~ngoswami@121.244.87.116) has joined #ceph
[10:12] * codice (~toodles@97-94-175-73.static.mtpk.ca.charter.com) has joined #ceph
[10:15] * dalgaaf (uid15138@id-15138.charlton.irccloud.com) has joined #ceph
[10:15] * Esge (~anadrom@3N2AABIE3.tor-irc.dnsbl.oftc.net) Quit ()
[10:16] * Kayla (~skrblr@digi00277.torproxy-readme-arachnide-fr-35.fr) has joined #ceph
[10:24] * garphy`aw is now known as garphy
[10:33] * rdas (~rdas@121.244.87.116) has joined #ceph
[10:35] * leseb- (~leseb@81-64-215-19.rev.numericable.fr) Quit (Quit: ZNC - http://znc.in)
[10:35] * leseb_ (~leseb@81-64-215-19.rev.numericable.fr) has joined #ceph
[10:36] * yguang11 (~yguang11@2406:2000:ef96:e::11f0) has joined #ceph
[10:37] * fmanana (~fdmanana@bl4-177-156.dsl.telepac.pt) has joined #ceph
[10:40] * yanzheng (~zhyan@182.149.64.145) has joined #ceph
[10:40] * cok (~chk@technet1-cph1.net.one.com) has joined #ceph
[10:42] * vbellur (~vijay@121.244.87.117) Quit (Ping timeout: 480 seconds)
[10:44] * TMM (~hp@173-38-208-169.cisco.com) has joined #ceph
[10:44] * alexxy[home] (~alexxy@2001:470:1f14:106::2) Quit (Ping timeout: 480 seconds)
[10:45] * Kayla (~skrblr@1CIAAGY24.tor-irc.dnsbl.oftc.net) Quit ()
[10:46] * Esge (~Wijk@tor-exit.server9.tvdw.eu) has joined #ceph
[10:48] * TMM (~hp@173-38-208-169.cisco.com) Quit ()
[10:48] * cok (~chk@technet1-cph1.net.one.com) Quit (Ping timeout: 480 seconds)
[10:49] * scuttlemonkey is now known as scuttle|afk
[10:50] * yanzheng (~zhyan@182.149.64.145) Quit (Quit: This computer has gone to sleep)
[10:50] * alexxy (~alexxy@2001:470:1f14:106::2) has joined #ceph
[10:55] * vbellur (~vijay@121.244.87.124) has joined #ceph
[10:57] * cok (~chk@nat-cph5-sys.net.one.com) has joined #ceph
[11:02] * cok (~chk@nat-cph5-sys.net.one.com) Quit ()
[11:04] * kefu (~kefu@114.92.100.153) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[11:05] * jordanP (~jordan@213.215.2.194) has joined #ceph
[11:05] * Miouge (~Miouge@94.136.92.20) Quit (Ping timeout: 480 seconds)
[11:05] * Miouge (~Miouge@94.136.92.20) has joined #ceph
[11:12] * Miouge (~Miouge@94.136.92.20) Quit (Quit: Miouge)
[11:14] * Miouge (~Miouge@94.136.92.20) has joined #ceph
[11:15] * bkopilov (~bkopilov@bzq-109-65-111-90.red.bezeqint.net) Quit (Ping timeout: 480 seconds)
[11:15] * krypto (~oftc-webi@hpm01cs005-ext.asiapac.hp.net) has joined #ceph
[11:15] * Esge (~Wijk@3N2AABIHP.tor-irc.dnsbl.oftc.net) Quit ()
[11:16] * bkopilov (~bkopilov@109.66.125.234) has joined #ceph
[11:16] * ChrisNBlum (~ChrisNBlu@dhcp-ip-230.dorf.rwth-aachen.de) has joined #ceph
[11:17] * Linkshot (~JWilbur@2BLAAF2ND.tor-irc.dnsbl.oftc.net) has joined #ceph
[11:20] <krypto> i have created a small 3 node cluster with 3 osds, fio benchmark on disks show "bw=5192.3KB/s, iops=1298 " also tried dd with direct and dsync,which is showing 18Mbps but ceph.log shows ~700kbps for any client write operation any idea what could be the issue?
[11:27] * i_m (~ivan.miro@nat-5-carp.hcn-strela.ru) Quit (Ping timeout: 480 seconds)
[11:29] * swami1 (~swami@49.32.0.191) Quit (Ping timeout: 480 seconds)
[11:33] * bkopilov (~bkopilov@109.66.125.234) Quit (Ping timeout: 480 seconds)
[11:33] * bkopilov (~bkopilov@bzq-79-180-133-17.red.bezeqint.net) has joined #ceph
[11:34] * badone (~brad@CPE-121-215-241-179.static.qld.bigpond.net.au) Quit (Ping timeout: 480 seconds)
[11:34] * vbellur (~vijay@121.244.87.124) Quit (Ping timeout: 480 seconds)
[11:38] * swami1 (~swami@49.32.0.191) has joined #ceph
[11:45] * Linkshot (~JWilbur@2BLAAF2ND.tor-irc.dnsbl.oftc.net) Quit ()
[11:49] * joelio (~joel@81.4.101.217) has joined #ceph
[11:50] * bkopilov (~bkopilov@bzq-79-180-133-17.red.bezeqint.net) Quit (Ping timeout: 480 seconds)
[11:50] <joelio> hrm, well thay upgrade to Hammer did not go well (currrently have a downed cluster)
[11:50] <joelio> some OSDs are taking up to 10GB each RAM
[11:51] <joelio> has there been some underlying change to the journal on disk stuff (it feels as thogugh the journal is being placed on ram)
[11:51] * joelio was not using SSDs for journal, just on disk (we had lots)
[11:51] <joelio> but that's kinda broken now as each OSD wants to consume 10GB each and I'm stuck with a downed cluster. Any advice appreciated!
[11:52] <joelio> was working fine of Giant, didn't think there was a change in spec for RAM requirements (the master docs do not say any different at least)
[11:55] <ramonskie> hammer is still in development as far as i know
[11:57] <joelio> yea, I appreciate that, mea culpa on that resepct
[11:57] <joelio> if there's a way to tune down this RAM requirements back to the recommended then I'll be fine :)
[11:58] <joelio> otherwise going to have to get creative
[11:59] <ramonskie> i can't find anything on that sorry :)
[11:59] <Be-El> joelio: does the osd perform backfilling operations? the ram usage during backfilling is way higher than normal
[12:00] <ramonskie> maby there is a memory leak or something did you try http://www.sebastien-han.fr/blog/2013/01/17/ceph-and-memory-profiling/
[12:02] * avozza (~avozza@80.66.23.10) has joined #ceph
[12:03] * infernix (nix@spirit.infernix.net) Quit (Ping timeout: 480 seconds)
[12:07] * infernix (nix@2001:41f0::ffff:ffff:ffff:fffe) has joined #ceph
[12:08] * kanagaraj (~kanagaraj@61.3.151.59) has joined #ceph
[12:09] <joelio> Be-El: yea, it is, but I've not seem it so high before, so it's new to me. I *think* I've got stuff on theright track
[12:10] <joelio> if push comes to shove I'll grab some RAM from our hpervisors and shove that in ;)
[12:10] * avozza (~avozza@80.66.23.10) Quit (Ping timeout: 480 seconds)
[12:13] * kanagaraj (~kanagaraj@61.3.151.59) Quit ()
[12:15] * treaki (~treaki@p5B031148.dip0.t-ipconnect.de) Quit (Quit: Leaving)
[12:15] * treaki (~treaki@p5B031148.dip0.t-ipconnect.de) has joined #ceph
[12:16] * Redshift (~zviratko@95.130.9.190) has joined #ceph
[12:18] * kevinkevin-work (6dbebb8f@107.161.19.109) has joined #ceph
[12:22] * swami1 (~swami@49.32.0.191) Quit (Ping timeout: 480 seconds)
[12:23] * shyu (~Shanzhi@119.254.196.66) Quit (Remote host closed the connection)
[12:26] * joelio (~joel@81.4.101.217) Quit (Quit: Changing server)
[12:27] * cok (~chk@2a02:2350:18:1010:b5bb:f859:4322:3525) has joined #ceph
[12:33] * yanzheng (~zhyan@182.149.64.145) has joined #ceph
[12:38] * Miouge (~Miouge@94.136.92.20) Quit (Quit: Miouge)
[12:38] * swami1 (~swami@49.32.0.191) has joined #ceph
[12:46] * Redshift (~zviratko@2BLAAF2OW.tor-irc.dnsbl.oftc.net) Quit ()
[12:46] * JWilbur (~Misacorp@orilla.enn.lu) has joined #ceph
[12:47] * rotbeard (~redbeard@b2b-94-79-138-170.unitymedia.biz) has joined #ceph
[12:50] * i_m (~ivan.miro@deibp9eh1--blueice2n2.emea.ibm.com) has joined #ceph
[13:01] * Be-El (~quassel@fb08-bcf-pc01.computational.bio.uni-giessen.de) Quit (Remote host closed the connection)
[13:01] <krypto> rados bench shows 290MBps but for "dd bs=4k" its 700Kbps is there any configuration required in client side,installed ceph using ceph-deploy
[13:01] * avozza (~avozza@80.66.23.10) has joined #ceph
[13:02] * Be-El (~quassel@fb08-bcf-pc01.computational.bio.uni-giessen.de) has joined #ceph
[13:03] * treaki (~treaki@p5B031148.dip0.t-ipconnect.de) Quit (Ping timeout: 480 seconds)
[13:03] * arbrandes (~arbrandes@152.250.242.214) has joined #ceph
[13:04] * overclk (~overclk@121.244.87.117) Quit (Quit: Leaving)
[13:10] * derjohn_mobi (~aj@fw.gkh-setu.de) Quit (Ping timeout: 480 seconds)
[13:11] * TMM (~hp@173-38-208-169.cisco.com) has joined #ceph
[13:16] * JWilbur (~Misacorp@3N2AABIMW.tor-irc.dnsbl.oftc.net) Quit ()
[13:16] * rushworld (~kalmisto@assk2.torservers.net) has joined #ceph
[13:22] <Kingrat> krypto, run dd bs=4M
[13:23] <krypto> Kingrat : for rados bench what block size is it using?
[13:24] * Miouge (~Miouge@94.136.92.20) has joined #ceph
[13:25] * Be-El (~quassel@fb08-bcf-pc01.computational.bio.uni-giessen.de) Quit (Remote host closed the connection)
[13:34] * Be-El (~quassel@fb08-bcf-pc01.computational.bio.uni-giessen.de) has joined #ceph
[13:34] * linjan (~linjan@195.110.41.9) Quit (Read error: Connection reset by peer)
[13:35] * linjan (~linjan@195.110.41.9) has joined #ceph
[13:35] * linjan (~linjan@195.110.41.9) Quit (Read error: Connection reset by peer)
[13:41] * diegows (~diegows@190.190.5.238) has joined #ceph
[13:42] * ganders (~root@200.32.121.70) has joined #ceph
[13:42] * zhaochao (~zhaochao@123.125.35.145) Quit (Quit: ChatZilla 0.9.91.1 [Iceweasel 31.5.0/20150225035911])
[13:43] * bkopilov (~bkopilov@bzq-79-182-12-57.red.bezeqint.net) has joined #ceph
[13:44] * Miouge (~Miouge@94.136.92.20) Quit (Quit: Miouge)
[13:45] * Nacer_ (~Nacer@252-87-190-213.intermediasud.com) has joined #ceph
[13:46] * rushworld (~kalmisto@2BLAAF2QE.tor-irc.dnsbl.oftc.net) Quit ()
[13:46] * delattec (~cdelatte@2606:a000:dd42:9e00:3e15:c2ff:feb8:dff8) has joined #ceph
[13:47] * Hejt (~W|ldCraze@tor-exit-node.xzyqvk.co.uk) has joined #ceph
[13:48] * lalatenduM (~lalatendu@121.244.87.117) Quit (Quit: Leaving)
[13:48] * Miouge (~Miouge@94.136.92.20) has joined #ceph
[13:49] * ramonskie (ab15507e@107.161.19.109) Quit (Quit: http://www.kiwiirc.com/ - A hand crafted IRC client)
[13:49] * lalatenduM (~lalatendu@121.244.87.124) has joined #ceph
[13:50] * jdillaman (~jdillaman@pool-108-56-67-212.washdc.fios.verizon.net) Quit (Quit: jdillaman)
[13:52] * Miouge (~Miouge@94.136.92.20) Quit ()
[13:52] * delatte (~cdelatte@204-235-114.160.twcable.com) Quit (Ping timeout: 480 seconds)
[13:52] * Nacer (~Nacer@252-87-190-213.intermediasud.com) Quit (Ping timeout: 480 seconds)
[13:54] * rdas (~rdas@121.244.87.116) Quit (Quit: Leaving)
[13:54] * vbellur (~vijay@122.178.198.209) has joined #ceph
[13:56] * Miouge (~Miouge@94.136.92.20) has joined #ceph
[13:56] * Miouge (~Miouge@94.136.92.20) Quit ()
[14:01] * Miouge (~Miouge@94.136.92.20) has joined #ceph
[14:02] * Miouge (~Miouge@94.136.92.20) Quit ()
[14:07] * t0rn (~ssullivan@c-68-62-1-186.hsd1.mi.comcast.net) has joined #ceph
[14:07] * t0rn (~ssullivan@c-68-62-1-186.hsd1.mi.comcast.net) has left #ceph
[14:09] * rwheeler (~rwheeler@173.48.208.246) has joined #ceph
[14:16] * Hejt (~W|ldCraze@1CIAAGZB9.tor-irc.dnsbl.oftc.net) Quit ()
[14:16] * Spikey (~Behedwin@3N2AABIQH.tor-irc.dnsbl.oftc.net) has joined #ceph
[14:17] * dneary (~dneary@nat-pool-bos-u.redhat.com) has joined #ceph
[14:22] * hellertime (~Adium@a72-246-0-10.deploy.akamaitechnologies.com) has joined #ceph
[14:22] * KevinPerks (~Adium@cpe-071-071-026-213.triad.res.rr.com) has joined #ceph
[14:24] * amote (~amote@121.244.87.116) Quit (Quit: Leaving)
[14:24] * kefu (~kefu@114.92.100.153) has joined #ceph
[14:25] * zack_dolby (~textual@pa3b3a1.tokynt01.ap.so-net.ne.jp) has joined #ceph
[14:30] * Manshoon (~Manshoon@c-50-181-29-219.hsd1.wv.comcast.net) has joined #ceph
[14:30] * Manshoon (~Manshoon@c-50-181-29-219.hsd1.wv.comcast.net) Quit (Remote host closed the connection)
[14:34] * kefu (~kefu@114.92.100.153) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[14:35] * ChrisNBlum (~ChrisNBlu@dhcp-ip-230.dorf.rwth-aachen.de) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[14:39] * marrusl (~mark@cpe-24-90-46-248.nyc.res.rr.com) has joined #ceph
[14:40] * dgurtner (~dgurtner@178.197.231.49) Quit (Remote host closed the connection)
[14:43] * kefu (~kefu@114.92.100.153) has joined #ceph
[14:43] * dyasny (~dyasny@198.251.56.133) has joined #ceph
[14:45] * yanzheng (~zhyan@182.149.64.145) Quit (Quit: This computer has gone to sleep)
[14:45] * dgurtner (~dgurtner@178.197.235.188) has joined #ceph
[14:46] * Spikey (~Behedwin@3N2AABIQH.tor-irc.dnsbl.oftc.net) Quit ()
[14:46] * dux0r (~rapedex@tor.het.net) has joined #ceph
[14:53] * yanzheng (~zhyan@182.149.64.145) has joined #ceph
[14:54] * b0e1 (~aledermue@213.95.25.82) has joined #ceph
[14:54] * fouxm (~foucault@ks01.commit.ninja) Quit (Quit: ZNC - http://znc.in)
[14:57] * swami1 (~swami@49.32.0.191) Quit (Quit: Leaving.)
[14:57] * yghannam (~yghannam@0001f8aa.user.oftc.net) has joined #ceph
[14:57] * fouxm (~foucault@ks01.commit.ninja) has joined #ceph
[14:57] * b0e (~aledermue@213.95.25.82) Quit (Ping timeout: 480 seconds)
[14:58] * krypto (~oftc-webi@hpm01cs005-ext.asiapac.hp.net) Quit (Quit: Page closed)
[15:00] * scuttle|afk is now known as scuttlemonkey
[15:03] * derjohn_mob (~aj@94.119.1.11) has joined #ceph
[15:03] * yanzheng (~zhyan@182.149.64.145) Quit (Quit: This computer has gone to sleep)
[15:03] * adeel (~adeel@fw1.ridgeway.scc-zip.net) has joined #ceph
[15:05] * sjm (~sjm@pool-98-109-11-113.nwrknj.fios.verizon.net) has joined #ceph
[15:06] * yanzheng (~zhyan@182.149.64.145) has joined #ceph
[15:10] * overclk (~overclk@122.167.224.179) has joined #ceph
[15:11] * wschulze (~wschulze@cpe-69-206-251-158.nyc.res.rr.com) has joined #ceph
[15:14] * tupper (~tcole@2001:420:2280:1272:8900:f9b8:3b49:567e) has joined #ceph
[15:14] * debian112 (~bcolbert@24.126.201.64) has joined #ceph
[15:16] * dux0r (~rapedex@2BLAAF2TA.tor-irc.dnsbl.oftc.net) Quit ()
[15:20] * yanzheng (~zhyan@182.149.64.145) Quit (Quit: This computer has gone to sleep)
[15:22] * xENO_ (~Coe|work@95.128.43.164) has joined #ceph
[15:24] * nitti (~nitti@162.222.47.218) has joined #ceph
[15:29] * yanzheng (~zhyan@182.149.64.145) has joined #ceph
[15:31] * dgurtner_ (~dgurtner@178.197.228.62) has joined #ceph
[15:31] * oms101 (~oms101@p20030057EA04E100EEF4BBFFFE0F7062.dip0.t-ipconnect.de) has joined #ceph
[15:32] * dgurtner (~dgurtner@178.197.235.188) Quit (Ping timeout: 480 seconds)
[15:44] * davidz (~davidz@2605:e000:1313:8003:85b9:118c:ab2f:1624) has joined #ceph
[15:49] * CephTestC (~CephTestC@199.91.185.156) Quit (Read error: No route to host)
[15:49] * CephTestC (~CephTestC@199.91.185.156) has joined #ceph
[15:50] * [arx] (~arx@six.mac-anu.org) has joined #ceph
[15:51] * xENO_ (~Coe|work@1CIAAGZHL.tor-irc.dnsbl.oftc.net) Quit ()
[15:53] * ChrisNBlum (~ChrisNBlu@dhcp-ip-230.dorf.rwth-aachen.de) has joined #ceph
[15:56] * MatthewH12 (~Hideous@manning1.torservers.net) has joined #ceph
[15:59] * lalatenduM (~lalatendu@121.244.87.124) Quit (Quit: Leaving)
[16:00] * lalatenduM (~lalatendu@121.244.87.117) has joined #ceph
[16:00] * danieagle (~Daniel@201-95-100-195.dsl.telesp.net.br) has joined #ceph
[16:01] * andreask (~andreask@2001:67c:1933:800::3200) Quit (Remote host closed the connection)
[16:01] * Manshoon (~Manshoon@208.184.50.131) has joined #ceph
[16:03] * Manshoon_ (~Manshoon@208.184.50.130) has joined #ceph
[16:06] <anorak> hello all. I created a block device "foo" following the quick start guide. all ok till now. when i attempted it to remove the device by first unmounting it (all ok here), it won't let me. For example, issuing the command "rbd rm foo" gives the error "2015-03-02 16:03:43.666110 7fb6e650e7c0 -1 librbd: image has watchers - not removing
[16:06] <anorak> Removing image: 0% complete...failed.
[16:06] <anorak> rbd: error: image still has watchers
[16:06] <anorak> This means the image is still open or the client using it crashed. Try again after closing/unmapping it or waiting 30s for the crashed client to timeout."
[16:07] <anorak> strange....i was about to copy paste the output of the listwatchers command....i had no watchers this time...i had the client itself first
[16:07] <anorak> now i can remove the device
[16:08] <anorak> even in this case, i had to restart the client
[16:09] <anorak> had anyone face a problem like this before? I am using firefly
[16:10] * nhm (~nhm@65-128-142-103.mpls.qwest.net) has joined #ceph
[16:10] * ChanServ sets mode +o nhm
[16:11] * Manshoon (~Manshoon@208.184.50.131) Quit (Ping timeout: 480 seconds)
[16:11] <burley_> anorak: I have seen similar, but after waiting was able to remove without issue and didn't really consider it much of an issue
[16:12] <burley_> I don't recall whether I was on giant or firefly at the time, has been a while since I last saw it
[16:12] * itamarl (~itamar@194.90.7.244) has joined #ceph
[16:13] * daniel2_ (~daniel2_@cpe-24-28-6-151.austin.res.rr.com) has joined #ceph
[16:13] * vata (~vata@208.88.110.46) has joined #ceph
[16:13] * nolan (~nolan@2001:470:1:41:a800:ff:fe3e:ad08) Quit (Quit: ZNC - http://znc.sourceforge.net)
[16:15] * nolan (~nolan@2001:470:1:41:a800:ff:fe3e:ad08) has joined #ceph
[16:16] * yanzheng (~zhyan@182.149.64.145) Quit (Quit: This computer has gone to sleep)
[16:16] <anorak> burley: Thanks! I did the same steps of creating it and found that i could not delete the device. ceph health shows it is doing something in the background (client io 58 B/s rd, 0 op/s)
[16:19] * b0e1 (~aledermue@213.95.25.82) Quit (Quit: Leaving.)
[16:19] <anorak> burley: how much do you wait usually to delete the device?
[16:20] * jdillaman (~jdillaman@pool-108-56-67-212.washdc.fios.verizon.net) has joined #ceph
[16:20] * dmsimard_away is now known as dmsimard
[16:23] * derjohn_mob (~aj@94.119.1.11) Quit (Ping timeout: 480 seconds)
[16:24] * cok (~chk@2a02:2350:18:1010:b5bb:f859:4322:3525) has left #ceph
[16:25] <burley_> I think so long as the unmap is run, you usually can pretty quickly thereafter
[16:26] * MatthewH12 (~Hideous@1CIAAGZJ0.tor-irc.dnsbl.oftc.net) Quit ()
[16:26] <seapasul1i> I'm running giant and I had a few osds that were full. I did ceph rebalance by utilization and now I am seeing tons of misplaced objects but I don't see it rebalancing. I can see 3 replicas though. I am not sure what's wrong.
[16:26] <seapasul1i> anyone seen this behaviour before?
[16:26] * Malcovent (~Quackie@exit1.torproxy.org) has joined #ceph
[16:30] * dgurtner_ (~dgurtner@178.197.228.62) Quit (Read error: Connection reset by peer)
[16:31] * derjohn_mob (~aj@94.119.1.11) has joined #ceph
[16:31] <anorak> burley: thanks!
[16:32] * Manshoon (~Manshoon@208.184.50.131) has joined #ceph
[16:34] * Manshoon (~Manshoon@208.184.50.131) Quit (Remote host closed the connection)
[16:35] * Manshoon (~Manshoon@199.16.199.4) has joined #ceph
[16:36] * Manshoon_ (~Manshoon@208.184.50.130) Quit (Ping timeout: 480 seconds)
[16:53] * garphy is now known as garphy`aw
[16:56] * Malcovent (~Quackie@2BLAAF2XC.tor-irc.dnsbl.oftc.net) Quit ()
[16:56] * dgurtner (~dgurtner@178.197.227.175) has joined #ceph
[16:57] * JamesHarrison (~hoopy@hessel2.torservers.net) has joined #ceph
[17:00] * jwilkins (~jwilkins@2601:9:4580:f4c:ea2a:eaff:fe08:3f1d) has joined #ceph
[17:03] * hasues (~hazuez@kwfw01.scrippsnetworksinteractive.com) has joined #ceph
[17:04] * hasues (~hazuez@kwfw01.scrippsnetworksinteractive.com) has left #ceph
[17:04] * TMM (~hp@173-38-208-169.cisco.com) Quit (Quit: Ex-Chat)
[17:06] * sputnik13 (~sputnik13@c-73-193-97-20.hsd1.wa.comcast.net) has joined #ceph
[17:07] * sputnik13 (~sputnik13@c-73-193-97-20.hsd1.wa.comcast.net) Quit ()
[17:11] * moore (~moore@64.202.160.88) has joined #ceph
[17:11] * hasues (~hasues@kwfw01.scrippsnetworksinteractive.com) has joined #ceph
[17:11] * hasues (~hasues@kwfw01.scrippsnetworksinteractive.com) has left #ceph
[17:12] * PerlStalker (~PerlStalk@162.220.127.20) has joined #ceph
[17:16] * vasu (~vasu@c-50-185-132-102.hsd1.ca.comcast.net) has joined #ceph
[17:17] * avozza (~avozza@80.66.23.10) Quit (Ping timeout: 480 seconds)
[17:18] * kefu (~kefu@114.92.100.153) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[17:20] * avozza (~avozza@80.66.23.10) has joined #ceph
[17:20] * ircolle (~Adium@2601:1:a580:145a:c412:2901:6ce9:d3fd) has joined #ceph
[17:22] * alram (~alram@cpe-172-250-2-46.socal.res.rr.com) has joined #ceph
[17:24] * daniel2_ (~daniel2_@cpe-24-28-6-151.austin.res.rr.com) Quit (Quit: My Mac has gone to sleep. ZZZzzz???)
[17:26] * JamesHarrison (~hoopy@2BLAAF2YO.tor-irc.dnsbl.oftc.net) Quit ()
[17:26] * Tarazed (~Salamande@tor-exit0-readme.dfri.se) has joined #ceph
[17:27] * reed (~reed@75-101-54-131.dsl.static.fusionbroadband.com) has joined #ceph
[17:29] * avozza (~avozza@80.66.23.10) Quit (Remote host closed the connection)
[17:29] * avozza (~avozza@80.66.23.10) has joined #ceph
[17:30] * overclk (~overclk@122.167.224.179) Quit (Ping timeout: 480 seconds)
[17:37] * avozza (~avozza@80.66.23.10) Quit (Ping timeout: 480 seconds)
[17:38] * bro__ (~flybyhigh@panik.darksystem.net) has joined #ceph
[17:41] * bro_ (~flybyhigh@panik.darksystem.net) Quit (Ping timeout: 480 seconds)
[17:43] * gregmark (~Adium@68.87.42.115) has joined #ceph
[17:46] * joshd (~jdurgin@24-205-54-236.dhcp.gldl.ca.charter.com) has joined #ceph
[17:46] * joshd (~jdurgin@24-205-54-236.dhcp.gldl.ca.charter.com) Quit ()
[17:48] * treaki (~treaki@p5B031148.dip0.t-ipconnect.de) has joined #ceph
[17:50] * laki (~laki@46.22.173.116) has joined #ceph
[17:50] <laki> Hi
[17:51] * rmoe (~quassel@173-228-89-134.dsl.static.fusionbroadband.com) Quit (Ping timeout: 480 seconds)
[17:51] <laki> got a question - is there an some easy option to show the cluster capacity related metrics ?
[17:54] <laki> beside looking at df output on each osd-host
[17:55] <burley_> rados df
[17:55] * diegows (~diegows@190.190.5.238) Quit (Ping timeout: 480 seconds)
[17:56] * Tarazed (~Salamande@1CIAAGZPD.tor-irc.dnsbl.oftc.net) Quit ()
[18:01] * bandrus (~brian@187.sub-70-211-74.myvzw.com) has joined #ceph
[18:02] * Manshoon (~Manshoon@199.16.199.4) Quit (Ping timeout: 480 seconds)
[18:02] * lalatenduM (~lalatendu@121.244.87.117) Quit (Quit: Leaving)
[18:04] * xophe_ (~xophe@ows-5-104-102-23.eu-west-1.compute.outscale.com) Quit (Quit: Lost terminal)
[18:04] * diegows (~diegows@190.190.5.238) has joined #ceph
[18:05] <laki> does it show shallow copy sizes,
[18:05] <laki> ?
[18:07] * itamarl_ (~itamar@194.90.7.244) has joined #ceph
[18:08] * rmoe (~quassel@12.164.168.117) has joined #ceph
[18:08] * itamarl_ (~itamar@194.90.7.244) Quit ()
[18:09] * itamarl (~itamar@194.90.7.244) Quit (Ping timeout: 480 seconds)
[18:09] * kawa2014 (~kawa@89.184.114.246) Quit (Quit: Leaving)
[18:12] * daniel2_ (~daniel2_@209.163.140.194) has joined #ceph
[18:12] * derjohn_mob (~aj@94.119.1.11) Quit (Ping timeout: 480 seconds)
[18:16] * oro (~oro@2001:620:20:16:384d:2075:2e42:8433) Quit (Ping timeout: 480 seconds)
[18:22] * derjohn_mob (~aj@fw.gkh-setu.de) has joined #ceph
[18:23] * puffy (~puffy@50.185.218.255) Quit (Quit: Leaving.)
[18:25] * Be-El (~quassel@fb08-bcf-pc01.computational.bio.uni-giessen.de) Quit (Remote host closed the connection)
[18:25] * xarses_ (~andreww@c-76-126-112-92.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[18:26] * Tonux (~drdanick@aurora.enn.lu) has joined #ceph
[18:27] * sputnik13 (~sputnik13@74.202.214.170) has joined #ceph
[18:34] <cmdrk_> are the xfsprogs published in the Ceph repos meant to be for OSDs or RBDs?
[18:35] <cmdrk_> ah, i see bug 5193
[18:35] <kraken> cmdrk_ might be talking about http://tracker.ceph.com/issues/5193 [RHEL6 does not ship with xfsprogs]
[18:35] * swami1 (~swami@116.75.100.132) has joined #ceph
[18:36] * Nacer_ (~Nacer@252-87-190-213.intermediasud.com) Quit (Ping timeout: 480 seconds)
[18:42] * laki (~laki@46.22.173.116) Quit (Quit: leaving)
[18:48] * tupper_ (~tcole@2001:420:2280:1272:8900:f9b8:3b49:567e) has joined #ceph
[18:49] * dgurtner (~dgurtner@178.197.227.175) Quit (Read error: No route to host)
[18:51] * Nacer (~Nacer@176.31.89.99) has joined #ceph
[18:55] * lalatenduM (~lalatendu@122.167.157.251) has joined #ceph
[18:56] * Tonux (~drdanick@3N2AABI1J.tor-irc.dnsbl.oftc.net) Quit ()
[18:56] * KUSmurf (~KapiteinK@vmd7027.contabo.host) has joined #ceph
[18:57] * avozza (~avozza@b2b-94-79-136-46.unitymedia.biz) has joined #ceph
[18:58] * cholcombe973 (~chris@7208-76ef-ff1f-ed2f-329a-f002-3420-2062.6rd.ip6.sonic.net) has joined #ceph
[18:58] * mykola (~Mikolaj@91.225.203.102) has joined #ceph
[18:59] * derjohn_mob (~aj@fw.gkh-setu.de) Quit (Ping timeout: 480 seconds)
[19:00] * xarses_ (~andreww@12.164.168.117) has joined #ceph
[19:04] * Manshoon (~Manshoon@208.184.50.131) has joined #ceph
[19:07] * i_m (~ivan.miro@deibp9eh1--blueice2n2.emea.ibm.com) Quit (Ping timeout: 480 seconds)
[19:07] * ngoswami (~ngoswami@121.244.87.116) Quit (Quit: Leaving)
[19:07] * qhartman (~qhartman@den.direwolfdigital.com) has joined #ceph
[19:08] <qhartman> I have a cluster with a handful of unfound objects, and the pgs that can't find the objects haven't probed all of the possible locations they know about for those objects
[19:09] <qhartman> Is there anyway I can force the pg to probe the osds it hasn't checked yet?
[19:09] * Manshoon (~Manshoon@208.184.50.131) Quit (Remote host closed the connection)
[19:09] <qhartman> It's been sitting in this state for several hours.
[19:10] * Manshoon (~Manshoon@199.16.199.4) has joined #ceph
[19:10] <qhartman> All the pgs that had probed everywhere I've flagged the objects as lost, but I don't want to give up on these until they've actually looked everywhere
[19:15] * KUSmurf (~KapiteinK@2BLAAF23G.tor-irc.dnsbl.oftc.net) Quit ()
[19:16] * Sami345 (~kiasyn@hessel0.torservers.net) has joined #ceph
[19:18] * ibuclaw (~ibuclaw@host81-150-190-145.in-addr.btopenworld.com) Quit (Quit: Leaving)
[19:18] * Nacer (~Nacer@176.31.89.99) Quit (Remote host closed the connection)
[19:19] * visbits (~textual@cpe-174-101-246-167.cinci.res.rr.com) has joined #ceph
[19:22] * puffy (~puffy@216.207.42.129) has joined #ceph
[19:25] * jordanP (~jordan@213.215.2.194) Quit (Quit: Leaving)
[19:29] * Sysadmin88 (~IceChat77@2.125.213.8) has joined #ceph
[19:31] * swami1 (~swami@116.75.100.132) Quit (Quit: Leaving.)
[19:35] * joshd (~jdurgin@38.122.20.226) has joined #ceph
[19:39] * platypython (~platypyth@207.173.166.41) has joined #ceph
[19:41] <platypython> Hello everyone! Use case question for you. I've got a few billion files, mostly less than 100k, across a home grown storage cluster. It works fine right now, but scaling is a pain. I'm playing with GlusterFS, which is great once the data is in there, but heaven help you if you need to delete a million files or copy the same, posix tools like cp and rm don't seem to be geared for this kind of overhead. It occurred to me that we really are running our
[19:41] <platypython> filesystem like a database now, and it's behaving poorly. Is this something that Ceph would improve? I don't have to have the posix compliant side, we could do all our adds and deletes through HTTP requests.
[19:43] * dmick1 is now known as dmick
[19:46] <qhartman> If you're using your files system like a database, why not migrate to a database?
[19:46] * Sami345 (~kiasyn@1CIAAGZWB.tor-irc.dnsbl.oftc.net) Quit ()
[19:48] * nitti (~nitti@162.222.47.218) Quit (Quit: Leaving...)
[19:48] <platypython> We have around 1 Petabyte of files and we need redundancy. MySQL has a lot of caveats with something that size
[19:48] * vbellur (~vijay@122.178.198.209) Quit (Ping timeout: 480 seconds)
[19:49] <qhartman> and to answer whether or not ceph would help, we'd need more information about your gluster setup. From what I've heard gluster's write performance tends to break down on file creates on very large clusters.
[19:50] <qhartman> so with that in mind, ceph may help, since afaik it does not have any kind of scaling issues like that.
[19:50] <platypython> Right now I'm just testing with 3 nodes, 4 bricks each with a 2x replica on ext4.
[19:50] <platypython> Gluster doesn't seem to be the weak link.
[19:51] <platypython> If I try to copy a directory tree that has 10 million files, cp will move data like a champ until about the 1 million mark, then it will fill up all the ram and slow to a crawl.
[19:52] <qhartman> ah, yeah, I've seen that before. I got around it by using rsync instead. But that's probably not a viable long-term solution for you.
[19:53] <platypython> Rsync was a little better, but it still can't get even close to the write speed of the cluster
[19:53] <qhartman> I doubt ceph will make a difference if that's the problem though
[19:53] * nitti (~nitti@162.222.47.218) has joined #ceph
[19:53] <qhartman> and you're moving stuff around inside the cluster? iow - you're sure your source isn't the bottleneck and / or you're not hairpinning data?
[19:54] <platypython> I'm trying to migrate data from our existing cluster to a new solution, once the data is in place it doesn't ever move.
[19:55] <platypython> But if it's going to take months to get the data in somewhere, I want to make sure its into a place that is going to work for the long term. I initially thought that Ceph would be overkill, but I'm thinking not now.
[19:56] * bkopilov (~bkopilov@bzq-79-182-12-57.red.bezeqint.net) Quit (Ping timeout: 480 seconds)
[19:57] * bkopilov (~bkopilov@bzq-109-66-129-167.red.bezeqint.net) has joined #ceph
[19:57] <platypython> I guess my root question is this, is Ceph capable of storing billions of objects and recalling those objects at a speed where the network is the only bottleneck?
[19:58] <platypython> Because XFS and ext4 can't do it, and I'm not familiar with how Ceph actually stores data.
[19:58] <qhartman> I haven't hit the billions of objects mark, but for my hundreds of millions, it does fine
[19:59] <platypython> Do you primarily send/receive over HTTP?
[19:59] <qhartman> I know ceph is used quite heavily by CERN, and I'd imagine they are at that volume.
[19:59] <qhartman> No, I work with librbd directly
[20:01] <burley_> dreamhost may also use it in that scale
[20:01] * hellertime (~Adium@a72-246-0-10.deploy.akamaitechnologies.com) Quit (Quit: Leaving.)
[20:01] <platypython> Yeah I read that DH has a 2PB cluster, but they also have a core developer on staff.
[20:03] <platypython> Thanks!
[20:03] * oro (~oro@80-219-254-208.dclient.hispeed.ch) has joined #ceph
[20:04] <burley_> have you considered hbase/hdfs as well?
[20:04] * Manshoon (~Manshoon@199.16.199.4) Quit (Ping timeout: 480 seconds)
[20:05] * LeaChim (~LeaChim@host109-152-119-231.range109-152.btcentralplus.com) has joined #ceph
[20:05] <burley_> IME I'd prefer ceph over hbase/hdfs, but they are another option that is in your space
[20:05] <platypython> I've read hadoop has a really stiff learinng curve, and I haven't wanted to commit
[20:06] <platypython> Considered Apache cassandra
[20:06] <platypython> Riak didn't work well
[20:06] * rwheeler (~rwheeler@173.48.208.246) Quit (Read error: Connection reset by peer)
[20:07] <qhartman> I've worked with cassandra a bit and similar to what it sounds like you're seeing, getting the data in was a bitch.
[20:07] <qhartman> once it was there it did well, but the big raw dump took forever
[20:08] <qhartman> It ended up taking long enough that we decided not to use it, and instead threw more hardware at our postgres setup instead to keep things going.
[20:08] * vbellur (~vijay@122.178.198.209) has joined #ceph
[20:09] * rwheeler (~rwheeler@173.48.208.246) has joined #ceph
[20:09] <qhartman> and this was ata data volume well below what you are talking about
[20:10] <platypython> So with librbd, do you just use python or something to read in files and dump them to a ceph bucket as an object?
[20:11] * xarses_ (~andreww@12.164.168.117) Quit (Ping timeout: 480 seconds)
[20:11] * ircolle is now known as ircolle-afk
[20:15] * _prime_ (~oftc-webi@199.168.44.192) has joined #ceph
[20:17] * MrBy (~MrBy@85.115.23.2) Quit (Ping timeout: 480 seconds)
[20:18] * AG_Scott (~loft@atlantic480.us.unmetered.com) has joined #ceph
[20:18] * MrBy (~MrBy@85.115.23.2) has joined #ceph
[20:18] * danieagle (~Daniel@201-95-100-195.dsl.telesp.net.br) Quit (Quit: Obrigado por Tudo! :-) inte+ :-))
[20:20] * segutier (~segutier@c-24-6-218-139.hsd1.ca.comcast.net) has joined #ceph
[20:22] * yghannam (~yghannam@0001f8aa.user.oftc.net) Quit (Quit: Leaving)
[20:23] * xarses_ (~andreww@12.164.168.117) has joined #ceph
[20:27] <qhartman> platypython, yeah. If we were to do it over again though, odds are we'd use rados through the object gateway: http://ceph.com/docs/master/radosgw/
[20:27] <qhartman> makes it behave like S3 for or less.
[20:27] <qhartman> s/for/more
[20:27] <kraken> qhartman meant to say: makes it behave like S3 more or less.
[20:34] * Manshoon (~Manshoon@208.184.50.131) has joined #ceph
[20:36] * linuxkidd (~linuxkidd@63.192.141.3) has joined #ceph
[20:38] * lalatenduM (~lalatendu@122.167.157.251) Quit (Quit: Leaving)
[20:38] * lalatenduM (~lalatendu@122.167.157.251) has joined #ceph
[20:39] * vbellur (~vijay@122.178.198.209) Quit (Ping timeout: 480 seconds)
[20:40] * Manshoon_ (~Manshoon@208.184.50.130) has joined #ceph
[20:41] * rotbeard (~redbeard@b2b-94-79-138-170.unitymedia.biz) Quit (Quit: Leaving)
[20:46] * AG_Scott (~loft@2BLAAF26N.tor-irc.dnsbl.oftc.net) Quit ()
[20:47] * Nanobot (~Arcturus@exit1.ipredator.se) has joined #ceph
[20:47] * Manshoon (~Manshoon@208.184.50.131) Quit (Ping timeout: 480 seconds)
[20:47] * segutier (~segutier@c-24-6-218-139.hsd1.ca.comcast.net) Quit (Quit: segutier)
[20:52] * lalatenduM (~lalatendu@122.167.157.251) Quit (Quit: Leaving)
[20:58] * fmanana (~fdmanana@bl4-177-156.dsl.telepac.pt) Quit (Ping timeout: 480 seconds)
[20:59] * i_m (~ivan.miro@nat-5-carp.hcn-strela.ru) has joined #ceph
[21:06] * Nacer (~Nacer@203-206-190-109.dsl.ovh.fr) has joined #ceph
[21:12] * gsigrisi (~oftc-webi@pub151248158024.dh-hfc.datazug.ch) has joined #ceph
[21:12] <gsigrisi> hi all
[21:13] <scuttlemonkey> dalgaaf: schedule posted. I tried to be mindful of your time constraints...hopefully having a day 2.1 for US/EMEA will help
[21:13] * scuttlemonkey changes topic to 'CDS Schedule Posted: http://goo.gl/i72wN8 || http://ceph.com/get || dev channel #ceph-devel || test lab channel #sepia'
[21:13] <gsigrisi> I'm running Centos 7 and and I'm building openstack. Unfortunately qemu-img doesn't have support for rbd. What repository I need to add to install qemu with rbd support?
[21:14] * Manshoon (~Manshoon@208.184.50.131) has joined #ceph
[21:14] * Manshoon (~Manshoon@208.184.50.131) Quit (Remote host closed the connection)
[21:15] <gsigrisi> I do have ceph-giant repos, qemu-img-1.5.3-60.el7_0.11.x86_64
[21:15] * Manshoon (~Manshoon@199.16.199.4) has joined #ceph
[21:16] * Nanobot (~Arcturus@2BLAAF27K.tor-irc.dnsbl.oftc.net) Quit ()
[21:16] * Frymaster (~PierreW@exit5.telostor.ca) has joined #ceph
[21:17] * yghannam (~yghannam@0001f8aa.user.oftc.net) has joined #ceph
[21:17] * DV (~veillard@2001:41d0:1:d478::1) Quit (Ping timeout: 480 seconds)
[21:18] <qhartman> I had the box running the mds in my cluster crash over the weekend, which in turn seems to have caused a number of OSDs to get into a bad state. Is this something that is known to happen when an MDS goes away, or would it make more sense that something else caused the OSD problems?
[21:19] * Manshoon_ (~Manshoon@208.184.50.130) Quit (Ping timeout: 480 seconds)
[21:22] * evilrob0_ (~evilrob00@cpe-72-179-3-209.austin.res.rr.com) has joined #ceph
[21:22] * evilrob00 (~evilrob00@cpe-72-179-3-209.austin.res.rr.com) Quit (Read error: Connection reset by peer)
[21:24] * Concubidated (~Adium@187.sub-70-211-74.myvzw.com) has joined #ceph
[21:27] * DV (~veillard@2001:41d0:a:f29f::1) has joined #ceph
[21:31] <lurbs> We used to maintain a local mirror of the Ceph repositories, but it seems as if rsync access to them is no longer available. Was this intended?
[21:32] * lpabon (~quassel@24-151-54-34.dhcp.nwtn.ct.charter.com) has joined #ceph
[21:33] <nwf> Hey gang. How might we recover from "2015-03-02 15:26:53.007641 7fd972de4700 0 log [ERR] : repair 10.60 cc1f0a60/rbd_header.c3ce102ae8944a/head//10 no 'snapset' attr" ? 'ceph pg repair' isn't doing it for us.
[21:35] * rotbeard (~redbeard@2a02:908:df10:d300:76f0:6dff:fe3b:994d) has joined #ceph
[21:37] <nwf> (It *looks* like pg 10.60 is available on another OSD and un-damaged there, but I am not sure.)
[21:41] * ganders (~root@200.32.121.70) Quit (Quit: WeeChat 0.4.2)
[21:41] * madkiss (~madkiss@88.128.80.203) has joined #ceph
[21:42] <nwf> (Hm, I take that back. the underlying file on both PGs is reporting 'bad address' when I try to 'getfattr'.)
[21:46] * Frymaster (~PierreW@2BLAAF28G.tor-irc.dnsbl.oftc.net) Quit ()
[21:47] * Freddy (~Sliker@46.226.110.185) has joined #ceph
[21:50] * Manshoon (~Manshoon@199.16.199.4) Quit (Remote host closed the connection)
[21:50] * Manshoon (~Manshoon@199.16.199.4) has joined #ceph
[21:55] * Nacer (~Nacer@203-206-190-109.dsl.ovh.fr) Quit (Remote host closed the connection)
[22:02] * visbits (~textual@cpe-174-101-246-167.cinci.res.rr.com) Quit (Quit: Textual IRC Client: www.textualapp.com)
[22:03] * visbits (~textual@cpe-174-101-246-167.cinci.res.rr.com) has joined #ceph
[22:05] * lpabon (~quassel@24-151-54-34.dhcp.nwtn.ct.charter.com) Quit (Remote host closed the connection)
[22:07] * fmanana (~fdmanana@bl4-177-156.dsl.telepac.pt) has joined #ceph
[22:12] * med (~medberry@71.74.177.250) Quit (Ping timeout: 480 seconds)
[22:13] * diegows (~diegows@190.190.5.238) Quit (Quit: Leaving)
[22:16] * oro (~oro@80-219-254-208.dclient.hispeed.ch) Quit (Ping timeout: 480 seconds)
[22:16] * Freddy (~Sliker@1CIAAGZ7O.tor-irc.dnsbl.oftc.net) Quit ()
[22:22] * jclm (~jclm@uconference.fw.utas.edu.au) has joined #ceph
[22:26] * jamespd (~mucky@mucky.socket7.org) Quit (Ping timeout: 480 seconds)
[22:28] * madkiss (~madkiss@88.128.80.203) Quit (Quit: Leaving.)
[22:30] * jamespd (~mucky@mucky.socket7.org) has joined #ceph
[22:40] * med (~medberry@71.74.177.250) has joined #ceph
[22:43] * jclm (~jclm@uconference.fw.utas.edu.au) Quit (Quit: Leaving.)
[22:43] * mykola (~Mikolaj@91.225.203.102) Quit (Quit: away)
[22:45] * xdeller (~xdeller@h195-91-128-218.ln.rinet.ru) Quit (Ping timeout: 480 seconds)
[22:46] * i_m (~ivan.miro@nat-5-carp.hcn-strela.ru) Quit (Ping timeout: 480 seconds)
[22:47] * smf68 (~Chrissi_@edwardsnowden2.torservers.net) has joined #ceph
[22:49] * sjm (~sjm@pool-98-109-11-113.nwrknj.fios.verizon.net) has left #ceph
[22:50] * xdeller (~xdeller@h195-91-128-218.ln.rinet.ru) has joined #ceph
[22:55] * oro (~oro@80-219-254-208.dclient.hispeed.ch) has joined #ceph
[22:55] * tupper (~tcole@2001:420:2280:1272:8900:f9b8:3b49:567e) Quit (Ping timeout: 480 seconds)
[22:55] * tupper_ (~tcole@2001:420:2280:1272:8900:f9b8:3b49:567e) Quit (Ping timeout: 480 seconds)
[22:55] * jclm (~jclm@uconference.fw.utas.edu.au) has joined #ceph
[22:58] * jwilkins (~jwilkins@2601:9:4580:f4c:ea2a:eaff:fe08:3f1d) Quit (Ping timeout: 480 seconds)
[22:59] * dneary (~dneary@nat-pool-bos-u.redhat.com) Quit (Ping timeout: 480 seconds)
[23:09] * jwilkins (~jwilkins@c-67-180-123-48.hsd1.ca.comcast.net) has joined #ceph
[23:12] * badone (~brad@CPE-121-215-241-179.static.qld.bigpond.net.au) has joined #ceph
[23:16] * smf68 (~Chrissi_@1CIAAG0B2.tor-irc.dnsbl.oftc.net) Quit ()
[23:17] * jamespd (~mucky@mucky.socket7.org) Quit (Remote host closed the connection)
[23:22] * xdeller (~xdeller@h195-91-128-218.ln.rinet.ru) Quit (Ping timeout: 480 seconds)
[23:23] * fmanana (~fdmanana@bl4-177-156.dsl.telepac.pt) Quit (Ping timeout: 480 seconds)
[23:23] * gregmark (~Adium@68.87.42.115) Quit (Quit: Leaving.)
[23:27] * tyson (~tyson@65-128-70-253.hlrn.qwest.net) has joined #ceph
[23:29] * xdeller (~xdeller@h195-91-128-218.ln.rinet.ru) has joined #ceph
[23:44] * oro (~oro@80-219-254-208.dclient.hispeed.ch) Quit (Ping timeout: 480 seconds)
[23:46] * Teddybareman (~visored@1CIAAG0F8.tor-irc.dnsbl.oftc.net) has joined #ceph
[23:49] * nljmo (~nljmo@5ED6C263.cm-7-7d.dynamic.ziggo.nl) Quit (Quit: Textual IRC Client: www.textualapp.com)
[23:49] * markl (~mark@knm.org) Quit (Remote host closed the connection)
[23:49] * markl_ (~mark@knm.org) Quit (Remote host closed the connection)
[23:50] * ircolle-afk (~Adium@2601:1:a580:145a:c412:2901:6ce9:d3fd) Quit (Quit: Leaving.)
[23:50] * visbits (~textual@cpe-174-101-246-167.cinci.res.rr.com) Quit (Quit: My iMac has gone to sleep. ZZZzzz???)
[23:51] * markl (~mark@knm.org) has joined #ceph
[23:56] * vata (~vata@208.88.110.46) Quit (Quit: Leaving.)
[23:56] * nljmo (~nljmo@5ED6C263.cm-7-7d.dynamic.ziggo.nl) has joined #ceph

These logs were automatically created by CephLogBot on irc.oftc.net using the Java IRC LogBot.