#ceph IRC Log

Index

IRC Log for 2012-06-25

Timestamps are in GMT/BST.

[0:04] * lofejndif (~lsqavnbok@659AAA69V.tor-irc.dnsbl.oftc.net) has joined #ceph
[1:31] * lotreck (~Adium@c-75-75-33-53.hsd1.va.comcast.net) has joined #ceph
[1:32] <lotreck> hello
[1:34] <lotreck> I've got two hosts , 6 TB each, and am trying to replicate across the two, however , when I mount via fuse it shows a single 12TB volume. Shouldn't it show a single 6TB volume ?
[1:46] * loicd (~loic@2a01:e35:2eba:db10:120b:a9ff:feb7:cce0) Quit (Quit: Leaving.)
[2:07] * lofejndif (~lsqavnbok@659AAA69V.tor-irc.dnsbl.oftc.net) Quit (Quit: gone)
[3:37] * BManojlovic (~steki@212.200.241.3) Quit (Quit: Ja odoh a vi sta 'ocete...)
[4:18] * Ryan_Lane (~Adium@dslb-178-008-042-229.pools.arcor-ip.net) has joined #ceph
[4:24] * Ryan_Lane1 (~Adium@dslb-092-078-139-119.pools.arcor-ip.net) Quit (Ping timeout: 480 seconds)
[4:31] * sjustlaptop (~sam@24-205-39-1.dhcp.gldl.ca.charter.com) has joined #ceph
[4:32] * renzhi (~renzhi@76.164.216.98) has joined #ceph
[5:10] * Ryan_Lane1 (~Adium@dslb-178-008-042-229.pools.arcor-ip.net) has joined #ceph
[5:10] * Ryan_Lane (~Adium@dslb-178-008-042-229.pools.arcor-ip.net) Quit (Read error: Connection reset by peer)
[5:10] * renzhi (~renzhi@76.164.216.98) Quit (Ping timeout: 480 seconds)
[5:12] * renzhi (~renzhi@66.197.225.53) has joined #ceph
[5:17] * sjustlaptop (~sam@24-205-39-1.dhcp.gldl.ca.charter.com) Quit (Ping timeout: 480 seconds)
[5:18] * Ryan_Lane1 (~Adium@dslb-178-008-042-229.pools.arcor-ip.net) Quit (Ping timeout: 480 seconds)
[5:24] * sjustlaptop (~sam@24-205-39-1.dhcp.gldl.ca.charter.com) has joined #ceph
[5:30] * cattelan is now known as cattelan_away
[6:20] * plastics (~plastics@c-69-138-42-222.hsd1.tn.comcast.net) has joined #ceph
[7:33] * sjustlaptop (~sam@24-205-39-1.dhcp.gldl.ca.charter.com) Quit (Ping timeout: 480 seconds)
[7:35] <iggy> lotreck: not really
[7:36] <iggy> lotreck: if you have a replication level of 1, that's 12T of usable space
[7:36] <iggy> if you have a replication level of 3, that's 4T usable
[7:37] * sjustlaptop (~sam@24-205-39-1.dhcp.gldl.ca.charter.com) has joined #ceph
[7:45] <lotreck> thanks
[7:45] <lotreck> I started my first testing of ceph today
[7:51] <lotreck> I've got two hosts . on one host I've got a mon/osd/mds and on the other I've got a osd
[7:51] <lotreck> my crushmap http://pastebin.com/xKPRR0HC
[7:51] <lotreck> not sure why that would give me 12TB of space
[7:53] <lotreck> I'm running ver 0.41
[8:03] * sjustlaptop (~sam@24-205-39-1.dhcp.gldl.ca.charter.com) Quit (Ping timeout: 480 seconds)
[8:05] * loicd (~loic@magenta.dachary.org) has joined #ceph
[8:16] * loicd (~loic@magenta.dachary.org) Quit (Quit: Leaving.)
[8:17] <iggy> I already said why it says 12T of space
[8:18] <iggy> the fs doesn't know if you are planning on making a directory with repl = 1
[8:24] <lotreck> what in my crushmap says 'repl = 1' ? or where does that get specified ?
[8:24] <iggy> the map can be changed
[9:01] * andreask (~andreas@chello062178013131.5.11.vie.surfer.at) has joined #ceph
[9:11] * MarkDude (~MT@c-71-198-138-155.hsd1.ca.comcast.net) Quit (Quit: Leaving)
[9:13] * loicd (~loic@83.167.43.235) has joined #ceph
[9:14] * verwilst (~verwilst@d5152FEFB.static.telenet.be) has joined #ceph
[9:16] * lotreck (~Adium@c-75-75-33-53.hsd1.va.comcast.net) Quit (Quit: Leaving.)
[9:19] * s[X]_ (~sX]@eth589.qld.adsl.internode.on.net) Quit (Remote host closed the connection)
[10:00] * s[X]_ (~sX]@ppp59-167-157-96.static.internode.on.net) has joined #ceph
[10:04] * BManojlovic (~steki@91.195.39.5) has joined #ceph
[10:32] * Ryan_Lane (~Adium@dslb-178-008-042-229.pools.arcor-ip.net) has joined #ceph
[10:38] * s[X]_ (~sX]@ppp59-167-157-96.static.internode.on.net) Quit (Remote host closed the connection)
[10:44] * The_Bishop (~bishop@2a01:198:2ee:0:1c18:d398:9758:f6e9) Quit (Quit: Wer zum Teufel ist dieser Peer? Wenn ich den erwische dann werde ich ihm mal die Verbindung resetten!)
[10:50] * s[X]_ (~sX]@ppp59-167-157-96.static.internode.on.net) has joined #ceph
[10:51] * s[X]_ (~sX]@ppp59-167-157-96.static.internode.on.net) Quit (Remote host closed the connection)
[10:55] * s[X]_ (~sX]@ppp59-167-157-96.static.internode.on.net) has joined #ceph
[11:05] * Ryan_Lane (~Adium@dslb-178-008-042-229.pools.arcor-ip.net) Quit (Quit: Leaving.)
[11:07] * s[X]_ (~sX]@ppp59-167-157-96.static.internode.on.net) Quit (Remote host closed the connection)
[11:19] * johnl (~johnl@2a02:1348:14c:1720:1860:8443:35ed:e764) Quit (Remote host closed the connection)
[11:19] * johnl (~johnl@2a02:1348:14c:1720:15aa:62af:5d99:6ece) has joined #ceph
[11:56] * Ryan_Lane (~Adium@p5DDC5B1B.dip.t-dialin.net) has joined #ceph
[12:03] * s[X]_ (~sX]@ppp59-167-157-96.static.internode.on.net) has joined #ceph
[12:27] * jbd_ (~jbd_@34322hpv162162.ikoula.com) has joined #ceph
[12:39] * lxo (~aoliva@lxo.user.oftc.net) Quit (Read error: No route to host)
[12:54] * The_Bishop (~bishop@e179016071.adsl.alicedsl.de) has joined #ceph
[12:54] * lxo (~aoliva@lxo.user.oftc.net) has joined #ceph
[13:07] * nhorman (~nhorman@hmsreliant.think-freely.org) has joined #ceph
[13:12] * mtk (~mtk@ool-44c35bb4.dyn.optonline.net) Quit (Ping timeout: 480 seconds)
[13:19] * mtk (~mtk@ool-44c35bb4.dyn.optonline.net) has joined #ceph
[13:44] * s[X]_ (~sX]@ppp59-167-157-96.static.internode.on.net) Quit (Remote host closed the connection)
[13:46] * The_Bishop_ (~bishop@e179015047.adsl.alicedsl.de) has joined #ceph
[13:47] * s[X]_ (~sX]@ppp59-167-157-96.static.internode.on.net) has joined #ceph
[13:47] * fghaas (~florian@91.119.140.169) has joined #ceph
[13:53] * The_Bishop (~bishop@e179016071.adsl.alicedsl.de) Quit (Ping timeout: 480 seconds)
[14:00] * fghaas (~florian@91.119.140.169) Quit (Quit: Leaving.)
[14:01] * s[X]_ (~sX]@ppp59-167-157-96.static.internode.on.net) Quit (Remote host closed the connection)
[14:09] * gregorg_taf (~Greg@78.155.152.6) has joined #ceph
[14:09] * gregorg (~Greg@78.155.152.6) Quit (Read error: Connection reset by peer)
[14:22] * s[X]_ (~sX]@ppp59-167-157-96.static.internode.on.net) has joined #ceph
[14:37] * gregorg (~Greg@78.155.152.6) has joined #ceph
[14:37] * gregorg_taf (~Greg@78.155.152.6) Quit (Read error: Connection reset by peer)
[14:46] * s[X]_ (~sX]@ppp59-167-157-96.static.internode.on.net) Quit (Remote host closed the connection)
[14:47] * s[X]_ (~sX]@ppp59-167-157-96.static.internode.on.net) has joined #ceph
[14:51] * aliguori (~anthony@cpe-70-123-145-39.austin.res.rr.com) has joined #ceph
[14:54] * cattelan_away is now known as cattelan
[15:10] * BManojlovic (~steki@91.195.39.5) Quit (Quit: Ja odoh a vi sta 'ocete...)
[15:10] * BManojlovic (~steki@91.195.39.5) has joined #ceph
[15:31] * loicd (~loic@83.167.43.235) Quit (Ping timeout: 480 seconds)
[16:46] * The_Bishop_ (~bishop@e179015047.adsl.alicedsl.de) Quit (Ping timeout: 480 seconds)
[16:48] * plastics (~plastics@c-69-138-42-222.hsd1.tn.comcast.net) Quit (Ping timeout: 480 seconds)
[16:55] * The_Bishop_ (~bishop@e179015047.adsl.alicedsl.de) has joined #ceph
[17:03] * verwilst (~verwilst@d5152FEFB.static.telenet.be) Quit (Quit: Ex-Chat)
[17:18] * BManojlovic (~steki@91.195.39.5) Quit (Remote host closed the connection)
[17:21] * The_Bishop_ (~bishop@e179015047.adsl.alicedsl.de) Quit (Quit: Wer zum Teufel ist dieser Peer? Wenn ich den erwische dann werde ich ihm mal die Verbindung resetten!)
[17:34] * Tv_ (~tv@aon.hq.newdream.net) has joined #ceph
[17:37] * bchrisman (~Adium@c-76-103-130-94.hsd1.ca.comcast.net) Quit (Quit: Leaving.)
[18:10] * nhorman (~nhorman@hmsreliant.think-freely.org) Quit (Ping timeout: 480 seconds)
[18:16] * yehudasa_ (~yehudasa@aon.hq.newdream.net) has joined #ceph
[18:17] * nhorman (~nhorman@hmsreliant.think-freely.org) has joined #ceph
[18:20] * sjustlaptop (~sam@aon.hq.newdream.net) has joined #ceph
[18:23] * andreask (~andreas@chello062178013131.5.11.vie.surfer.at) Quit (Ping timeout: 480 seconds)
[18:28] * bchrisman (~Adium@c-76-103-130-94.hsd1.ca.comcast.net) has joined #ceph
[18:32] * gregaf (~Adium@aon.hq.newdream.net) has left #ceph
[18:34] * gregaf (~Adium@aon.hq.newdream.net) has joined #ceph
[18:36] * jbd_ (~jbd_@34322hpv162162.ikoula.com) has left #ceph
[18:37] * sjustlaptop (~sam@aon.hq.newdream.net) Quit (Ping timeout: 480 seconds)
[19:11] * BManojlovic (~steki@212.200.241.3) has joined #ceph
[19:14] * jluis (~JL@89.181.149.17) has joined #ceph
[19:18] * chutzpah (~chutz@216.174.109.254) has joined #ceph
[19:19] * joao (~JL@89.181.145.234) Quit (Ping timeout: 480 seconds)
[19:24] * loicd (~loic@2a01:e35:2eba:db10:120b:a9ff:feb7:cce0) has joined #ceph
[19:39] * dmick (~dmick@aon.hq.newdream.net) has joined #ceph
[19:41] * ninkotech (~duplo@89.177.137.231) Quit (Quit: Konversation terminated!)
[19:44] * loicd (~loic@2a01:e35:2eba:db10:120b:a9ff:feb7:cce0) Quit (Quit: Leaving.)
[19:45] * loicd (~loic@magenta.dachary.org) has joined #ceph
[19:48] * yehudasa_ (~yehudasa@aon.hq.newdream.net) Quit (Ping timeout: 480 seconds)
[20:02] * Ryan_Lane (~Adium@p5DDC5B1B.dip.t-dialin.net) Quit (Quit: Leaving.)
[20:05] * ninkotech (~duplo@89.177.137.231) has joined #ceph
[20:09] * nik (~nik@mobile-198-228-196-064.mycingular.net) has joined #ceph
[20:10] * nik (~nik@mobile-198-228-196-064.mycingular.net) Quit ()
[20:10] * lofejndif (~lsqavnbok@28IAAFAPV.tor-irc.dnsbl.oftc.net) has joined #ceph
[20:11] * nearbeer (~nik@mobile-198-228-196-064.mycingular.net) has joined #ceph
[20:14] <nearbeer> Hello, I've got two hosts with 2Tb each and see that repl = 2 which tells me that I'm replicating across hosts correctly I believe. What I don't understand is why my total available disk space shows 4Tb.
[20:15] <nearbeer> Shouldn't this show 2tb of available space? Thanks.
[20:16] <gregaf> nearbeer: you can set different replication levels in different "pools", so the total available space is always reported in raw space
[20:19] <nearbeer> gregaf: Ah. Is there a way to see available space for the pool ? Other than for me to sed/grep the output from the ceph cmd?
[20:19] <gregaf> well, you take the raw space and you divide by the replication setting :)
[20:20] <nearbeer> :) works for me
[20:25] * adjohn (~adjohn@50-0-133-101.dsl.static.sonic.net) has joined #ceph
[20:35] * danieagle (~Daniel@177.43.213.15) has joined #ceph
[20:44] * Ryan_Lane (~Adium@dslb-178-008-042-229.pools.arcor-ip.net) has joined #ceph
[20:46] * nearbeer (~nik@mobile-198-228-196-064.mycingular.net) Quit (Quit: Colloquy for iPad - http://colloquy.mobi)
[21:35] * sjustlaptop (~sam@aon.hq.newdream.net) has joined #ceph
[21:43] * sjustlaptop (~sam@aon.hq.newdream.net) Quit (Ping timeout: 480 seconds)
[22:06] * lofejndif (~lsqavnbok@28IAAFAPV.tor-irc.dnsbl.oftc.net) Quit (Quit: gone)
[22:12] * andreask (~andreas@chello062178013131.5.11.vie.surfer.at) has joined #ceph
[22:16] * s[X]_ (~sX]@ppp59-167-157-96.static.internode.on.net) Quit (Remote host closed the connection)
[22:18] * The_Bishop (~bishop@p5DC11956.dip.t-dialin.net) has joined #ceph
[22:25] * nearbeer (~nik@mobile-198-228-196-064.mycingular.net) has joined #ceph
[22:26] <nearbeer> Is there any guidance in osds per disk vs per server with a raid 5?
[22:27] <gregaf> the first uses more memory and cpu, but the second means you have to do more recovery if you lose two of the disks in a node, and adds even more disk overhead
[22:27] * danieagle (~Daniel@177.43.213.15) Quit (Remote host closed the connection)
[22:28] <gregaf> we work mostly with the first choice, but there's at least one person in the channel who made the second (don't remember who)
[22:28] <gregaf> unfortunately there aren't enough long-lived deployments to compare against to have evidence for which is actually better long-ter
[22:28] <gregaf> *long-term
[22:30] * nhorman (~nhorman@hmsreliant.think-freely.org) Quit (Quit: Leaving)
[22:31] <nearbeer> gregaf: Thanks for the info. Are there any service providers that you know of that are using ceph in production? If so, at what scale?
[22:32] <gregaf> I know at least one has it in alpha or beta testing, with???~4PB of raw disk?
[22:32] <gregaf> err, they're using RADOS and the RADOS gateway, that is
[22:32] <gregaf> nobody's using the full filesystem anywhere near production yet; it's not ready for that :)
[22:33] <nearbeer> So, instead of mounting via fuse or 'mount -t ceph' I should look , perhaps at only rados gw for now?
[22:34] <gregaf> that and rbd :)
[22:35] <nearbeer> Okay. That helps a lot. Thanks
[22:38] <dmick> toying with things with the Python binding for rbd (and the commandline rados and rbd tools) is a pretty low-bar way of getting some experience with the cluster
[22:38] <dmick> s/for rbd/for rados and rbd/
[22:55] * cattelan (~cattelan@2001:4978:267:0:21c:c0ff:febf:814b) Quit (Read error: Operation timed out)
[22:57] * nearbeer (~nik@mobile-198-228-196-064.mycingular.net) Quit (Quit: Colloquy for iPad - http://colloquy.mobi)
[23:00] * plastics (~plastics@c-69-138-42-222.hsd1.tn.comcast.net) has joined #ceph
[23:01] * brambles (brambles@79.133.200.49) Quit (Remote host closed the connection)
[23:03] * nearbeer (~nik@198.228.196.64) has joined #ceph
[23:04] <nearbeer> So, are rados and the rados gw production ready? I think I read that somewhere ...
[23:04] * lxo (~aoliva@lxo.user.oftc.net) Quit (Ping timeout: 480 seconds)
[23:05] <dmick> production-ready is always a judgement call, but, as gregaf noted, we have customers in late-alpha/early-beta. We think it's pretty stable
[23:05] <nearbeer> Thanks!
[23:11] * MarkDude (~MT@c-71-198-138-155.hsd1.ca.comcast.net) has joined #ceph
[23:13] * lxo (~aoliva@lxo.user.oftc.net) has joined #ceph
[23:14] * brambles (brambles@79.133.200.49) has joined #ceph
[23:15] * nearbeer (~nik@198.228.196.64) Quit (Quit: Colloquy for iPad - http://colloquy.mobi)
[23:19] * yehudasa_ (~yehudasa@aon.hq.newdream.net) has joined #ceph
[23:24] * s[X]_ (~sX]@ppp59-167-157-96.static.internode.on.net) has joined #ceph
[23:35] * s[X]_ (~sX]@ppp59-167-157-96.static.internode.on.net) Quit (Remote host closed the connection)
[23:35] * sjustlaptop (~sam@aon.hq.newdream.net) has joined #ceph
[23:40] * nolan (~nolan@2001:470:1:41:20c:29ff:fe9a:60be) Quit (Remote host closed the connection)
[23:41] * OutBackDingo (~quassel@rrcs-71-43-84-222.se.biz.rr.com) Quit (Remote host closed the connection)
[23:42] * nolan (~nolan@2001:470:1:41:20c:29ff:fe9a:60be) has joined #ceph
[23:42] * sjustlaptop1 (~sam@aon.hq.newdream.net) has joined #ceph
[23:46] * sjustlaptop (~sam@aon.hq.newdream.net) Quit (Ping timeout: 480 seconds)
[23:52] * plastics- (~plastics@c-69-138-42-222.hsd1.tn.comcast.net) has joined #ceph
[23:55] * brambles (brambles@79.133.200.49) Quit (Quit: leaving)
[23:55] * brambles (brambles@79.133.200.49) has joined #ceph
[23:57] * s[X] (~sX]@eth589.qld.adsl.internode.on.net) has joined #ceph
[23:57] * plastics (~plastics@c-69-138-42-222.hsd1.tn.comcast.net) Quit (Ping timeout: 480 seconds)
[23:59] * plastics- (~plastics@c-69-138-42-222.hsd1.tn.comcast.net) Quit (Read error: Connection reset by peer)
[23:59] * plastics (~plastics@c-69-138-42-222.hsd1.tn.comcast.net) has joined #ceph

These logs were automatically created by CephLogBot on irc.oftc.net using the Java IRC LogBot.