postgres-xc-developers Mailing List for Postgres-XC

Abbas,
Can you take a look, the plpgsql test case is failing again in BF
regression from couple of days ago...


On Tue, May 7, 2013 at 6:43 AM, Ashutosh Bapat <
ash...@en...> wrote:

> Ok, this is good to go then.
>
>
> On Tue, Apr 30, 2013 at 6:00 PM, Abbas Butt <abb...@en...>wrote:
>
>>
>>
>> On Tue, Apr 30, 2013 at 5:04 PM, Ashutosh Bapat <
>> ash...@en...> wrote:
>>
>>> Hi Abbas,
>>> This change looks confusing. The statements where you have added order
>>> by clause do not correspond to the statements where you have changed the
>>> output. Can you please explain this?
>>>
>>
>> The output of the test cases are changed because there was an error in
>> the expected output files of these test cases. These outputs have to be
>> modified (and the modified output is correct) because of your check in
>> 2608af3d5288607e8245fa10e74e7307bb1bb23d.
>>
>> The order by clause is added in test cases where the expected output was
>> already in order, but results were coming out to be in different order
>> depending on node configuration.
>>
>>
>>>
>>> Also, whenever you change .sql and need to change the .out for that,
>>> please change all the alt. expected output files.
>>>
>>
>> Sure
>>
>>
>>>
>>>
>>> On Thu, Apr 25, 2013 at 4:58 PM, Abbas Butt <abb...@en...
>>> > wrote:
>>>
>>>> Hi,
>>>> Attached please find patch to fix test case plpgsql. The test was
>>>> failing for some order by issues, Also there were some errors in expected
>>>> output.
>>>>
>>>> --
>>>> *Abbas*
>>>>  Architect
>>>>
>>>> Ph: 92.334.5100153
>>>>  Skype ID: gabbasb
>>>> www.enterprisedb.co <http://www.enterprisedb.com/>m<http://www.enterprisedb.com/>
>>>> *
>>>> Follow us on Twitter*
>>>> @EnterpriseDB
>>>>
>>>> Visit EnterpriseDB for tutorials, webinars, whitepapers<http://www.enterprisedb.com/resources-community>and more<http://www.enterprisedb.com/resources-community>
>>>>
>>>>
>>>> ------------------------------------------------------------------------------
>>>> Try New Relic Now & We'll Send You this Cool Shirt
>>>> New Relic is the only SaaS-based application performance monitoring
>>>> service
>>>> that delivers powerful full stack analytics. Optimize and monitor your
>>>> browser, app, & servers with just a few lines of code. Try New Relic
>>>> and get this awesome Nerd Life shirt!
>>>> http://p.sf.net/sfu/newrelic_d2d_apr
>>>> _______________________________________________
>>>> Postgres-xc-developers mailing list
>>>> Pos...@li...
>>>> https://lists.sourceforge.net/lists/listinfo/postgres-xc-developers
>>>>
>>>>
>>>
>>>
>>> --
>>> Best Wishes,
>>> Ashutosh Bapat
>>> EntepriseDB Corporation
>>> The Postgres Database Company
>>>
>>
>>
>>
>> --
>> --
>> *Abbas*
>>  Architect
>>
>> Ph: 92.334.5100153
>>  Skype ID: gabbasb
>> www.enterprisedb.co <http://www.enterprisedb.com/>m<http://www.enterprisedb.com/>
>> *
>> Follow us on Twitter*
>> @EnterpriseDB
>>
>> Visit EnterpriseDB for tutorials, webinars, whitepapers<http://www.enterprisedb.com/resources-community>and more<http://www.enterprisedb.com/resources-community>
>>
>
>
>
> --
> Best Wishes,
> Ashutosh Bapat
> EntepriseDB Corporation
> The Postgres Database Company
>
>
> ------------------------------------------------------------------------------
> Learn Graph Databases - Download FREE O'Reilly Book
> "Graph Databases" is the definitive new guide to graph databases and
> their applications. This 200-page book is written by three acclaimed
> leaders in the field. The early access version is available now.
> Download your free book today! http://p.sf.net/sfu/neotech_d2d_may
> _______________________________________________
> Postgres-xc-developers mailing list
> Pos...@li...
> https://lists.sourceforge.net/lists/listinfo/postgres-xc-developers
>
>


-- 
Ahsan Hadi
Snr Director Product Development
EnterpriseDB Corporation
The Enterprise Postgres Company

Phone: +92-51-8358874
Mobile: +92-333-5162114

Website: www.enterprisedb.com
EnterpriseDB Blog: http://blogs.enterprisedb.com/
Follow us on Twitter: http://www.twitter.com/enterprisedb

This e-mail message (and any attachment) is intended for the use of the
individual or entity to whom it is addressed. This message contains
information from EnterpriseDB Corporation that may be privileged,
confidential, or exempt from disclosure under applicable law. If you are
not the intended recipient or authorized to receive this for the intended
recipient, any use, dissemination, distribution, retention, archiving, or
copying of this communication is strictly prohibited. If you have received
this e-mail in error, please notify the sender immediately by reply e-mail
and delete this message.

Abbas,
Can you please review this patch this week?


On Tue, May 21, 2013 at 3:55 AM, Amit Khandekar <
ami...@en...> wrote:

> Currently the number of tuples processed is updated in both
> HandleCommandComplete and ExecInsert/Update/Delete.
>
> In HandleCommandComplete() it gets it from the command tag returned from
> the datanode i.e. INSERT 0 2, UPDATE 5 and likewise. And then it updates
> estate->es_processed. But it does this only for FQS. For non-FQS, in
> ExecInsert/Update,  it is just incremented by 1. So if a trigger function
> skips one row on datanode, the command tag returned from datanode is INSERT
> 0 0. But still in ExecInsert() increments the row count.
>
> I have added a new field RemoteQueryState->rqs_processed, which is updated
> in HandleCommandComplete(). Then it is used in ExecInsert/Update/Delete()
> for non-FQS, and in RemoteQueryNext() for FQS.
>
> While fixing this issue, I see that there seem to be some issue with
> combiner->command_complete_count. Currently it checks for consistency of
> number of tuples returned for replicated tables, but it does that only for
> FQS. Need to completely remove the dependency on whether it's an FQS or
> non-FQS DML query. For this, command_complete_count needs to be better
> handled. I felt it needs some refactoring which I did not feel good to do
> in this release. Currently this field is being updated for each iteration
> of FetchTuple by re-using the same combiner for each iteration, whereas it
> seems it should be updated only for each node execution, not for each tuple
> fetched. I haven't touched this part, but added a TODO, and opened 3613645.
>
> Added some testcases in existing tests xc_trigship and xc_returning.
>
>
>
>
> ------------------------------------------------------------------------------
> Try New Relic Now & We'll Send You this Cool Shirt
> New Relic is the only SaaS-based application performance monitoring service
> that delivers powerful full stack analytics. Optimize and monitor your
> browser, app, & servers with just a few lines of code. Try New Relic
> and get this awesome Nerd Life shirt! http://p.sf.net/sfu/newrelic_d2d_may
> _______________________________________________
> Postgres-xc-developers mailing list
> Pos...@li...
> https://lists.sourceforge.net/lists/listinfo/postgres-xc-developers
>
>


-- 
Ahsan Hadi
Snr Director Product Development
EnterpriseDB Corporation
The Enterprise Postgres Company

Phone: +92-51-8358874
Mobile: +92-333-5162114

Website: www.enterprisedb.com
EnterpriseDB Blog: http://blogs.enterprisedb.com/
Follow us on Twitter: http://www.twitter.com/enterprisedb

This e-mail message (and any attachment) is intended for the use of the
individual or entity to whom it is addressed. This message contains
information from EnterpriseDB Corporation that may be privileged,
confidential, or exempt from disclosure under applicable law. If you are
not the intended recipient or authorized to receive this for the intended
recipient, any use, dissemination, distribution, retention, archiving, or
copying of this communication is strictly prohibited. If you have received
this e-mail in error, please notify the sender immediately by reply e-mail
and delete this message.

Abbas,
Are you planning to commit this soon?


On Fri, May 17, 2013 at 5:26 AM, Ashutosh Bapat <
ash...@en...> wrote:

> This looks good. Are there other ways where we can have UPDATE statement
> somewhere in the query tree list? Do we need to worry about such cases.
>
>
> On Fri, May 17, 2013 at 2:22 PM, Abbas Butt <abb...@en...>wrote:
>
>>
>>
>> On Thu, May 16, 2013 at 2:25 PM, Ashutosh Bapat <
>> ash...@en...> wrote:
>>
>>> Hi Abbas,
>>> Instead of fixing the first issue in pgxc_build_dml_statement(), is it
>>> possible to traverse the Query in validate_part_col_updatable() recursively
>>> to find UPDATE statements and apply partition column check?
>>>
>>
>> Yes. I have attached that patch for your feedback. If you think its ok I
>> can send the updated patch including the rest of the changes.
>>
>>
>>>  That would cover all the possibilities, I guess. That also saves us
>>> much effort in case we come to support distribution column updation.
>>>
>>> I think, we need a generic solution to solve this command id issue, e.g.
>>> punching command id always and efficiently. But for now this suffices.
>>> Please log a bug/feature and put it in 1.2 bucket.
>>>
>>
>> Done.
>> (Artifact 3613498<https://sourceforge.net/tracker/?func=detail&aid=3613498&group_id=311227&atid=1310235>
>> )
>>
>>>
>>>
>>>
>>>
>>> On Wed, May 15, 2013 at 5:31 AM, Abbas Butt <abb...@en...
>>> > wrote:
>>>
>>>> Adding developers mailing list.
>>>>
>>>>
>>>> On Wed, May 15, 2013 at 4:57 AM, Abbas Butt <
>>>> abb...@en...> wrote:
>>>>
>>>>> Hi,
>>>>> Attached please find a patch to fix test case with.
>>>>> There were two issues making the test to fail.
>>>>> 1. Updates to partition column were possible using syntax like
>>>>>     WITH t AS (UPDATE y SET a=a+1 RETURNING *) SELECT * FROM t
>>>>>     The patch blocks this syntax.
>>>>>
>>>>> 2.  For a WITH query that updates a table in the main query and
>>>>>      inserts a row in the same table in the WITH query we need to use
>>>>>      command ID communication to remote nodes in order to
>>>>>      maintain global data visibility.
>>>>>      For example
>>>>>      CREATE TEMP TABLE tab (id int,val text) DISTRIBUTE BY REPLICATION;
>>>>>      INSERT INTO tab VALUES (1,'p1');
>>>>>      WITH wcte AS (INSERT INTO tab VALUES(42,'new') RETURNING id AS
>>>>> newid)
>>>>>      UPDATE tab SET id = id + newid FROM wcte;
>>>>>      The last query gets translated into the following multi-statement
>>>>>      transaction on the primary datanode
>>>>>      (a) START TRANSACTION ISOLATION LEVEL read committed READ WRITE
>>>>>      (b) INSERT INTO tab (id, val) VALUES ($1, $2) RETURNING id --
>>>>> (42,'new)'
>>>>>      (c) SELECT id, val, ctid FROM ONLY tab WHERE true
>>>>>      (d) UPDATE ONLY tab tab SET id = $1 WHERE (tab.ctid = $3) --
>>>>> (43,(0,1)]
>>>>>      (e) COMMIT TRANSACTION
>>>>>      The command id of the select in step (c), should be such that
>>>>>      it does not see the insert of step (b)
>>>>>
>>>>> Comments are welcome.
>>>>>
>>>>> Regards
>>>>>
>>>>> --
>>>>> *Abbas*
>>>>>  Architect
>>>>>
>>>>> Ph: 92.334.5100153
>>>>>  Skype ID: gabbasb
>>>>> www.enterprisedb.co <http://www.enterprisedb.com/>m<http://www.enterprisedb.com/>
>>>>> *
>>>>> Follow us on Twitter*
>>>>> @EnterpriseDB
>>>>>
>>>>> Visit EnterpriseDB for tutorials, webinars, whitepapers<http://www.enterprisedb.com/resources-community>and more<http://www.enterprisedb.com/resources-community>
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> --
>>>> *Abbas*
>>>>  Architect
>>>>
>>>> Ph: 92.334.5100153
>>>>  Skype ID: gabbasb
>>>> www.enterprisedb.co <http://www.enterprisedb.com/>m<http://www.enterprisedb.com/>
>>>> *
>>>> Follow us on Twitter*
>>>> @EnterpriseDB
>>>>
>>>> Visit EnterpriseDB for tutorials, webinars, whitepapers<http://www.enterprisedb.com/resources-community>and more<http://www.enterprisedb.com/resources-community>
>>>>
>>>>
>>>> ------------------------------------------------------------------------------
>>>> AlienVault Unified Security Management (USM) platform delivers complete
>>>> security visibility with the essential security capabilities. Easily and
>>>> efficiently configure, manage, and operate all of your security controls
>>>> from a single console and one unified framework. Download a free trial.
>>>> http://p.sf.net/sfu/alienvault_d2d
>>>> _______________________________________________
>>>> Postgres-xc-core mailing list
>>>> Pos...@li...
>>>> https://lists.sourceforge.net/lists/listinfo/postgres-xc-core
>>>>
>>>>
>>>
>>>
>>> --
>>> Best Wishes,
>>> Ashutosh Bapat
>>> EntepriseDB Corporation
>>> The Postgres Database Company
>>>
>>
>>
>>
>> --
>> --
>> *Abbas*
>>  Architect
>>
>> Ph: 92.334.5100153
>>  Skype ID: gabbasb
>> www.enterprisedb.co <http://www.enterprisedb.com/>m<http://www.enterprisedb.com/>
>> *
>> Follow us on Twitter*
>> @EnterpriseDB
>>
>> Visit EnterpriseDB for tutorials, webinars, whitepapers<http://www.enterprisedb.com/resources-community>and more<http://www.enterprisedb.com/resources-community>
>>
>
>
>
> --
> Best Wishes,
> Ashutosh Bapat
> EntepriseDB Corporation
> The Postgres Database Company
>
>
> ------------------------------------------------------------------------------
> AlienVault Unified Security Management (USM) platform delivers complete
> security visibility with the essential security capabilities. Easily and
> efficiently configure, manage, and operate all of your security controls
> from a single console and one unified framework. Download a free trial.
> http://p.sf.net/sfu/alienvault_d2d
> _______________________________________________
> Postgres-xc-core mailing list
> Pos...@li...
> https://lists.sourceforge.net/lists/listinfo/postgres-xc-core
>
>


-- 
Ahsan Hadi
Snr Director Product Development
EnterpriseDB Corporation
The Enterprise Postgres Company

Phone: +92-51-8358874
Mobile: +92-333-5162114

Website: www.enterprisedb.com
EnterpriseDB Blog: http://blogs.enterprisedb.com/
Follow us on Twitter: http://www.twitter.com/enterprisedb

This e-mail message (and any attachment) is intended for the use of the
individual or entity to whom it is addressed. This message contains
information from EnterpriseDB Corporation that may be privileged,
confidential, or exempt from disclosure under applicable law. If you are
not the intended recipient or authorized to receive this for the intended
recipient, any use, dissemination, distribution, retention, archiving, or
copying of this communication is strictly prohibited. If you have received
this e-mail in error, please notify the sender immediately by reply e-mail
and delete this message.