Maximum size of a point Cloud.

classic Classic list List threaded Threaded
13 messages Options
Reply | Threaded
Open this post in threaded view
|

Maximum size of a point Cloud.

harsha00790
Hi,
I have a set of around 200 point clouds,aligned.When i am trying to combine them the program is crashing.I think the problem is the maximum size.It worked fine for 20 clouds,but is crashing if point clouds are more.
How to combine all and get one cloud?
Reply | Threaded
Open this post in threaded view
|

Re: Maximum size of a point Cloud.

harsha00790
I am getting a Bad Allocation Exception.But I have over 50 GB of free space.
Reply | Threaded
Open this post in threaded view
|

Re: Maximum size of a point Cloud.

andersgb1
Your disk space does not set the limit for a run-time operation, rather your memory. What is the collected size of the point clouds, and how does your code look?


On 28 February 2013 09:47, harsha00790 <[hidden email]> wrote:
I am getting a Bad Allocation Exception.But I have over 50 GB of free space.



--
View this message in context: http://www.pcl-users.org/Maximum-size-of-a-point-Cloud-tp4026450p4026452.html
Sent from the Point Cloud Library (PCL) Users mailing list mailing list archive at Nabble.com.
_______________________________________________
[hidden email] / http://pointclouds.org
http://pointclouds.org/mailman/listinfo/pcl-users


_______________________________________________
[hidden email] / http://pointclouds.org
http://pointclouds.org/mailman/listinfo/pcl-users
Reply | Threaded
Open this post in threaded view
|

Re: Maximum size of a point Cloud.

harsha00790
Here is my code,
#include <iostream>
#include <pcl/io/pcd_io.h>
#include <pcl/point_types.h>
#include <conio.h>
#include <pcl\point_cloud.h>
#include <pcl/common/point_operators.h>
#include <exception>

void main()
{
        FILE *fp;
        pcl::PointCloud<pcl::PointXYZRGBA>::Ptr final(new pcl::PointCloud<pcl::PointXYZRGBA>);
        pcl::PointCloud<pcl::PointXYZRGBA> temp;
        fp = fopen("CloudListout.txt","r");
        char *p = new char[100];
        int i = 0;
        if(fp == NULL)
        {
                printf("Failed to OpenFIle");
                exit(0);
        }
        while(fscanf(fp,"%s",p)!=EOF)
        {
                try
                {
                pcl::io::loadPCDFile<pcl::PointXYZRGBA> (p,temp);
                *final = *final + temp;
                }
                catch(std::exception e)
                {
                std::cout << "Exception" << e.what() ;
                }
        }
        pcl::io::savePCDFile("Result.pcd",*final, true);
        getch();
}

I have about 200 point clouds,each around 6.5MB,taken with Kinect.
Reply | Threaded
Open this post in threaded view
|

Re: Maximum size of a point Cloud.

andersgb1
OK, so no exception is caught? Maybe you could try putting an extra wildcard catch(...) around the concatenation operation? Otherwise, you need to either use cout, gdb or valgrind to see which line is actually causing trouble.


On 28 February 2013 10:07, harsha00790 <[hidden email]> wrote:
Here is my code,
#include <iostream>
#include <pcl/io/pcd_io.h>
#include <pcl/point_types.h>
#include <conio.h>
#include <pcl\point_cloud.h>
#include <pcl/common/point_operators.h>
#include <exception>

void main()
{
        FILE *fp;
        pcl::PointCloud<pcl::PointXYZRGBA>::Ptr final(new
pcl::PointCloud<pcl::PointXYZRGBA>);
        pcl::PointCloud<pcl::PointXYZRGBA> temp;
        fp = fopen("CloudListout.txt","r");
        char *p = new char[100];
        int i = 0;
        if(fp == NULL)
        {
                printf("Failed to OpenFIle");
                exit(0);
        }
        while(fscanf(fp,"%s",p)!=EOF)
        {
                try
                {
                pcl::io::loadPCDFile<pcl::PointXYZRGBA> (p,temp);
                *final = *final + temp;
                }
                catch(std::exception e)
                {
                std::cout << "Exception" << e.what() ;
                }
        }
        pcl::io::savePCDFile("Result.pcd",*final, true);
        getch();
}

I have about 200 point clouds,each around 6.5MB,taken with Kinect.



--
View this message in context: http://www.pcl-users.org/Maximum-size-of-a-point-Cloud-tp4026450p4026456.html
Sent from the Point Cloud Library (PCL) Users mailing list mailing list archive at Nabble.com.
_______________________________________________
[hidden email] / http://pointclouds.org
http://pointclouds.org/mailman/listinfo/pcl-users


_______________________________________________
[hidden email] / http://pointclouds.org
http://pointclouds.org/mailman/listinfo/pcl-users
Reply | Threaded
Open this post in threaded view
|

Re: Maximum size of a point Cloud.

harsha00790
Exception is caught.Bad_Allocation Exception is caught after the first few concatenations.
Reply | Threaded
Open this post in threaded view
|

Re: Maximum size of a point Cloud.

andersgb1
Ahh, I see. OK, then I don't think there's anything you can do. You're simply running out of memory :(

There is, however, still the possibility of using e.g. the octree downsampling for compression after each concatenation in order to remove redundant points. This greatly reduces the amount of data, but of course your original data is not retained.

-Anders


On 28 February 2013 10:15, harsha00790 <[hidden email]> wrote:
Exception is caught.Bad_Allocation Exception is caught after the first few
concatenations.



--
View this message in context: http://www.pcl-users.org/Maximum-size-of-a-point-Cloud-tp4026450p4026458.html
Sent from the Point Cloud Library (PCL) Users mailing list mailing list archive at Nabble.com.
_______________________________________________
[hidden email] / http://pointclouds.org
http://pointclouds.org/mailman/listinfo/pcl-users


_______________________________________________
[hidden email] / http://pointclouds.org
http://pointclouds.org/mailman/listinfo/pcl-users
Reply | Threaded
Open this post in threaded view
|

Re: Maximum size of a point Cloud.

harsha00790
I Have 6GB Ram,but it is only showing 3Gb in the task manager and it says remaining 3GB is for pagin.Do you have any idea what it is.I Know it is not PCL related.


On Thu, Feb 28, 2013 at 2:48 PM, andersgb1 [via Point Cloud Library (PCL) Users mailing list] <[hidden email]> wrote:
Ahh, I see. OK, then I don't think there's anything you can do. You're simply running out of memory :(

There is, however, still the possibility of using e.g. the octree downsampling for compression after each concatenation in order to remove redundant points. This greatly reduces the amount of data, but of course your original data is not retained.

-Anders


On 28 February 2013 10:15, harsha00790 <[hidden email]> wrote:
Exception is caught.Bad_Allocation Exception is caught after the first few
concatenations.



--
View this message in context: http://www.pcl-users.org/Maximum-size-of-a-point-Cloud-tp4026450p4026458.html

Sent from the Point Cloud Library (PCL) Users mailing list mailing list archive at Nabble.com.
_______________________________________________
[hidden email] / http://pointclouds.org
http://pointclouds.org/mailman/listinfo/pcl-users


If you reply to this email, your message will be added to the discussion below:
http://www.pcl-users.org/Maximum-size-of-a-point-Cloud-tp4026450p4026459.html
To unsubscribe from Maximum size of a point Cloud., click here.
NAML

Reply | Threaded
Open this post in threaded view
|

Re: Maximum size of a point Cloud.

andersgb1
Hmm, I see. Yeah, I know it's not PCL related, but still seems a bit weird. Maybe you want to look into whether your Windows settings are disallowing user space applications to use too much memory.


On 28 February 2013 10:20, harsha00790 <[hidden email]> wrote:
I Have 6GB Ram,but it is only showing 3Gb in the task manager and it says
remaining 3GB is for pagin.Do you have any idea what it is.I Know it is not
PCL related.


On Thu, Feb 28, 2013 at 2:48 PM, andersgb1 [via Point Cloud Library (PCL)
Users mailing list] <[hidden email]> wrote:

> Ahh, I see. OK, then I don't think there's anything you can do. You're
> simply running out of memory :(
>
> There is, however, still the possibility of using e.g. the octree
> downsampling for compression after each concatenation in order to remove
> redundant points. This greatly reduces the amount of data, but of course
> your original data is not retained.
>
> -Anders
>
>
> On 28 February 2013 10:15, harsha00790 <[hidden email]<http://user/SendEmail.jtp?type=node&node=4026459&i=0>
> > wrote:
>
>> Exception is caught.Bad_Allocation Exception is caught after the first few
>> concatenations.
>>
>>
>>
>> --
>> View this message in context:
>> http://www.pcl-users.org/Maximum-size-of-a-point-Cloud-tp4026450p4026458.html
>>
>> Sent from the Point Cloud Library (PCL) Users mailing list mailing list
>> archive at Nabble.com.
>> _______________________________________________
>> [hidden email] <http://user/SendEmail.jtp?type=node&node=4026459&i=1> /
>> http://pointclouds.org
>> http://pointclouds.org/mailman/listinfo/pcl-users
>>
>
>
> _______________________________________________
> [hidden email] <http://user/SendEmail.jtp?type=node&node=4026459&i=2> /
> http://pointclouds.org
> http://pointclouds.org/mailman/listinfo/pcl-users
>
>
> ------------------------------
>  If you reply to this email, your message will be added to the discussion
> below:
>
> http://www.pcl-users.org/Maximum-size-of-a-point-Cloud-tp4026450p4026459.html
>  To unsubscribe from Maximum size of a point Cloud., click here< > .
> NAML<
http://www.pcl-users.org/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>




--
View this message in context: http://www.pcl-users.org/Maximum-size-of-a-point-Cloud-tp4026450p4026460.html
Sent from the Point Cloud Library (PCL) Users mailing list mailing list archive at Nabble.com.
_______________________________________________
[hidden email] / http://pointclouds.org
http://pointclouds.org/mailman/listinfo/pcl-users


_______________________________________________
[hidden email] / http://pointclouds.org
http://pointclouds.org/mailman/listinfo/pcl-users
Reply | Threaded
Open this post in threaded view
|

Re: Maximum size of a point Cloud.

harsha00790
Thanks..... i will see what i can do..


On Thu, Feb 28, 2013 at 2:54 PM, andersgb1 [via Point Cloud Library (PCL) Users mailing list] <[hidden email]> wrote:
Hmm, I see. Yeah, I know it's not PCL related, but still seems a bit weird. Maybe you want to look into whether your Windows settings are disallowing user space applications to use too much memory.


On 28 February 2013 10:20, harsha00790 <[hidden email]> wrote:
I Have 6GB Ram,but it is only showing 3Gb in the task manager and it says
remaining 3GB is for pagin.Do you have any idea what it is.I Know it is not
PCL related.


On Thu, Feb 28, 2013 at 2:48 PM, andersgb1 [via Point Cloud Library (PCL)
Users mailing list] <[hidden email]> wrote:

> Ahh, I see. OK, then I don't think there's anything you can do. You're
> simply running out of memory :(
>
> There is, however, still the possibility of using e.g. the octree
> downsampling for compression after each concatenation in order to remove
> redundant points. This greatly reduces the amount of data, but of course
> your original data is not retained.
>
> -Anders
>
>
> On 28 February 2013 10:15, harsha00790 <[hidden email]<http://user/SendEmail.jtp?type=node&node=4026459&i=0>

> > wrote:
>
>> Exception is caught.Bad_Allocation Exception is caught after the first few
>> concatenations.
>>
>>
>>
>> --
>> View this message in context:
>> http://www.pcl-users.org/Maximum-size-of-a-point-Cloud-tp4026450p4026458.html
>>
>> Sent from the Point Cloud Library (PCL) Users mailing list mailing list
>> archive at Nabble.com.
>> _______________________________________________
>> [hidden email] <http://user/SendEmail.jtp?type=node&node=4026459&i=1> /

>> http://pointclouds.org
>> http://pointclouds.org/mailman/listinfo/pcl-users
>>
>
>
> _______________________________________________
> [hidden email] <http://user/SendEmail.jtp?type=node&node=4026459&i=2> /
> http://pointclouds.org
> http://pointclouds.org/mailman/listinfo/pcl-users
>
>
> ------------------------------

>  If you reply to this email, your message will be added to the discussion
> below:
>
> http://www.pcl-users.org/Maximum-size-of-a-point-Cloud-tp4026450p4026459.html
>  To unsubscribe from Maximum size of a point Cloud., click here<
> .
> NAML<
http://www.pcl-users.org/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>




--
View this message in context: http://www.pcl-users.org/Maximum-size-of-a-point-Cloud-tp4026450p4026460.html

Sent from the Point Cloud Library (PCL) Users mailing list mailing list archive at Nabble.com.
_______________________________________________
[hidden email] / http://pointclouds.org
http://pointclouds.org/mailman/listinfo/pcl-users

If you reply to this email, your message will be added to the discussion below:
http://www.pcl-users.org/Maximum-size-of-a-point-Cloud-tp4026450p4026461.html
To unsubscribe from Maximum size of a point Cloud., click here.
NAML

Reply | Threaded
Open this post in threaded view
|

Re: Maximum size of a point Cloud.

xnoybis
Are you using the x86 libraries? 32-bit applications cannot allocate more than around 3GB under normal circumstances, so anything beyond that will throw no matter how much spare ram you have.

Using the x64 libraries would resolve this, or you could try the /LARGEADDRESSAWARE flag in MSVC
(which I've had mixed results with)

On 28 February 2013 09:30, harsha00790 <[hidden email]> wrote:
Thanks..... i will see what i can do..


On Thu, Feb 28, 2013 at 2:54 PM, andersgb1 [via Point Cloud Library (PCL)
Users mailing list] <[hidden email]> wrote:

> Hmm, I see. Yeah, I know it's not PCL related, but still seems a bit
> weird. Maybe you want to look into whether your Windows settings are
> disallowing user space applications to use too much memory.
>
>
> On 28 February 2013 10:20, harsha00790 <[hidden email]<http://user/SendEmail.jtp?type=node&node=4026461&i=0>
> > wrote:
>
>> I Have 6GB Ram,but it is only showing 3Gb in the task manager and it says
>> remaining 3GB is for pagin.Do you have any idea what it is.I Know it is
>> not
>> PCL related.
>>
>>
>> On Thu, Feb 28, 2013 at 2:48 PM, andersgb1 [via Point Cloud Library (PCL)
>> Users mailing list] <[hidden email]<http://user/SendEmail.jtp?type=node&node=4026461&i=1>>
>> wrote:
>>
>> > Ahh, I see. OK, then I don't think there's anything you can do. You're
>> > simply running out of memory :(
>> >
>> > There is, however, still the possibility of using e.g. the octree
>> > downsampling for compression after each concatenation in order to remove
>> > redundant points. This greatly reduces the amount of data, but of course
>> > your original data is not retained.
>> >
>> > -Anders
>> >
>> >
>> > On 28 February 2013 10:15, harsha00790 <[hidden email]<
>> http://user/SendEmail.jtp?type=node&node=4026459&i=0>
>>
>> > > wrote:
>> >
>> >> Exception is caught.Bad_Allocation Exception is caught after the first
>> few
>> >> concatenations.
>> >>
>> >>
>> >>
>> >> --
>> >> View this message in context:
>> >>
>> http://www.pcl-users.org/Maximum-size-of-a-point-Cloud-tp4026450p4026458.html
>> >>
>> >> Sent from the Point Cloud Library (PCL) Users mailing list mailing list
>> >> archive at Nabble.com.
>> >> _______________________________________________
>> >> [hidden email] <http://user/SendEmail.jtp?type=node&node=4026459&i=1>
>> /
>>
>> >> http://pointclouds.org
>> >> http://pointclouds.org/mailman/listinfo/pcl-users
>> >>
>> >
>> >
>> > _______________________________________________
>> > [hidden email] <http://user/SendEmail.jtp?type=node&node=4026459&i=2> /
>> > http://pointclouds.org
>> > http://pointclouds.org/mailman/listinfo/pcl-users
>> >
>> >
>> > ------------------------------
>>
>> >  If you reply to this email, your message will be added to the
>> discussion
>> > below:
>> >
>> >
>> http://www.pcl-users.org/Maximum-size-of-a-point-Cloud-tp4026450p4026459.html
>> >  To unsubscribe from Maximum size of a point Cloud., click here<
>> [hidden email] <http://user/SendEmail.jtp?type=node&node=4026461&i=2> /
>> http://pointclouds.org
>> http://pointclouds.org/mailman/listinfo/pcl-users
>>
>
>
> _______________________________________________
> [hidden email] <http://user/SendEmail.jtp?type=node&node=4026461&i=3> /
> http://pointclouds.org
> http://pointclouds.org/mailman/listinfo/pcl-users
>
>
> ------------------------------
>  If you reply to this email, your message will be added to the discussion
> below:
>
> http://www.pcl-users.org/Maximum-size-of-a-point-Cloud-tp4026450p4026461.html
View this message in context: http://www.pcl-users.org/Maximum-size-of-a-point-Cloud-tp4026450p4026462.html
Sent from the Point Cloud Library (PCL) Users mailing list mailing list archive at Nabble.com.
_______________________________________________
[hidden email] / http://pointclouds.org
http://pointclouds.org/mailman/listinfo/pcl-users



--
Ben Martin

Senior Software Engineer

HOLITION AUGMENTED RETAIL


_______________________________________________
[hidden email] / http://pointclouds.org
http://pointclouds.org/mailman/listinfo/pcl-users
Reply | Threaded
Open this post in threaded view
|

Re: Maximum size of a point Cloud.

harsha00790
Yes,I am using x86 libraries.Although i don't think 200 point clouds will take 3GB of ram.I tried working with x64 libraries but i had some compatibility issues with x86 apps.So,i started working with x86.




On Thu, Feb 28, 2013 at 3:33 PM, xnoybis [via Point Cloud Library (PCL) Users mailing list] <[hidden email]> wrote:
Are you using the x86 libraries? 32-bit applications cannot allocate more than around 3GB under normal circumstances, so anything beyond that will throw no matter how much spare ram you have.

Using the x64 libraries would resolve this, or you could try the /LARGEADDRESSAWARE flag in MSVC
(which I've had mixed results with)

On 28 February 2013 09:30, harsha00790 <[hidden email]> wrote:
Thanks..... i will see what i can do..


On Thu, Feb 28, 2013 at 2:54 PM, andersgb1 [via Point Cloud Library (PCL)
Users mailing list] <[hidden email]> wrote:

> Hmm, I see. Yeah, I know it's not PCL related, but still seems a bit
> weird. Maybe you want to look into whether your Windows settings are
> disallowing user space applications to use too much memory.
>
>
> On 28 February 2013 10:20, harsha00790 <[hidden email]<http://user/SendEmail.jtp?type=node&node=4026461&i=0>

> > wrote:
>
>> I Have 6GB Ram,but it is only showing 3Gb in the task manager and it says
>> remaining 3GB is for pagin.Do you have any idea what it is.I Know it is
>> not
>> PCL related.
>>
>>
>> On Thu, Feb 28, 2013 at 2:48 PM, andersgb1 [via Point Cloud Library (PCL)
>> Users mailing list] <[hidden email]<http://user/SendEmail.jtp?type=node&node=4026461&i=1>>

>> wrote:
>>
>> > Ahh, I see. OK, then I don't think there's anything you can do. You're
>> > simply running out of memory :(
>> >
>> > There is, however, still the possibility of using e.g. the octree
>> > downsampling for compression after each concatenation in order to remove
>> > redundant points. This greatly reduces the amount of data, but of course
>> > your original data is not retained.
>> >
>> > -Anders
>> >
>> >
>> > On 28 February 2013 10:15, harsha00790 <[hidden email]<
>> http://user/SendEmail.jtp?type=node&node=4026459&i=0>
>>
>> > > wrote:
>> >
>> >> Exception is caught.Bad_Allocation Exception is caught after the first
>> few
>> >> concatenations.
>> >>
>> >>
>> >>
>> >> --
>> >> View this message in context:
>> >>
>> http://www.pcl-users.org/Maximum-size-of-a-point-Cloud-tp4026450p4026458.html
>> >>
>> >> Sent from the Point Cloud Library (PCL) Users mailing list mailing list
>> >> archive at Nabble.com.
>> >> _______________________________________________
>> >> [hidden email] <http://user/SendEmail.jtp?type=node&node=4026459&i=1>
>> /
>>
>> >> http://pointclouds.org
>> >> http://pointclouds.org/mailman/listinfo/pcl-users
>> >>
>> >
>> >
>> > _______________________________________________
>> > [hidden email] <http://user/SendEmail.jtp?type=node&node=4026459&i=2> /
>> > http://pointclouds.org
>> > http://pointclouds.org/mailman/listinfo/pcl-users
>> >
>> >
>> > ------------------------------
>>
>> >  If you reply to this email, your message will be added to the
>> discussion
>> > below:
>> >
>> >
>> http://www.pcl-users.org/Maximum-size-of-a-point-Cloud-tp4026450p4026459.html
>> >  To unsubscribe from Maximum size of a point Cloud., click here<
>> [hidden email] <http://user/SendEmail.jtp?type=node&node=4026461&i=2> /

>> http://pointclouds.org
>> http://pointclouds.org/mailman/listinfo/pcl-users
>>
>
>
> _______________________________________________
> [hidden email] <http://user/SendEmail.jtp?type=node&node=4026461&i=3> /

> http://pointclouds.org
> http://pointclouds.org/mailman/listinfo/pcl-users
>
>
> ------------------------------
>  If you reply to this email, your message will be added to the discussion
> below:
>
> http://www.pcl-users.org/Maximum-size-of-a-point-Cloud-tp4026450p4026461.htmlView this message in context: http://www.pcl-users.org/Maximum-size-of-a-point-Cloud-tp4026450p4026462.html

Sent from the Point Cloud Library (PCL) Users mailing list mailing list archive at Nabble.com.
_______________________________________________
[hidden email] / http://pointclouds.org
http://pointclouds.org/mailman/listinfo/pcl-users



--
Ben Martin

Senior Software Engineer

HOLITION AUGMENTED RETAIL

If you reply to this email, your message will be added to the discussion below:
http://www.pcl-users.org/Maximum-size-of-a-point-Cloud-tp4026450p4026465.html
To unsubscribe from Maximum size of a point Cloud., click here.
NAML

Reply | Threaded
Open this post in threaded view
|

Re: Maximum size of a point Cloud.

niranjan
In reply to this post by harsha00790
Hey,
I want to know what is the maximum file size does PCL can handle?
Also I want to know the maximum point size limit in PCL?



--
Sent from: http://www.pcl-users.org/
_______________________________________________
[hidden email] / http://pointclouds.org
http://pointclouds.org/mailman/listinfo/pcl-users