execute_view_dataframe_shaped aggregates data when there are repeated elements in a dimension

[svbtropical]

Describe the bug
Hi guys,

This is an issue reported by one of our customers in PowerConnect.

When using execute_view_dataframe_shaped with iterative_json=True, if an element is repeatead in rows, its data gets aggregated:

However, when using use_iterative_json=False, this doesn't happen:

To Reproduce
Create a view that contains a dimension subset with repeated elements in it.

Expected behavior
It should not aggregate the data but show the element twice.

Version
I replicated this in TM1py 2.0.4 & 2.2
TM1 Server Version: 11.8.01900.10

[MariusWirtz]

Good catch, thank you!

We will look into this asap

[MariusWirtz]

@svbtropical
Please upgrade to branch 1323-fix-aggregation-behaviour-on-shaped-dataframes and verify that it resolves this problem.
Please also verify that the fix doesn't have any side effects.

pip uninstall tm1py
pip install https://github.com/cubewise-code/tm1py/archive/refs/heads/1323-fix-aggregation-behaviour-on-shaped-dataframes.zip

[svbtropical]

Hi @MariusWirtz,

Great, i'll check it out. Thanks!

Cheers!

[svbtropical]

Hi @MariusWirtz,

I'm consistently getting the CookieConflictError mentioned in #1237.

requests.cookies.CookieConflictError: There are multiple cookies with name, 'TM1SessionId'

when connecting to an specific TM1 instance. I'm not experiencing it on 2.0.3.

The interesting part is that I can't replicate it from jupyter and I can't see what's different.

After connecting to TM1 with basic auth, I get the error after doing:

tm1_user = tm1.security.get_user(username)

This is the full trace of the error:

Traceback (most recent call last):
  File "C:\Code\PowerConnect\powerconnect\WebServer\utils.py", line 299, in getimpersonateuser
    tm1_user = tm1.security.get_user(username)
  File "c:\Users\elias\anaconda3\envs\test-service\lib\site-packages\TM1py\Services\SecurityService.py", line 57, in get_user
    user_name = self.determine_actual_user_name(user_name, **kwargs)
  File "c:\Users\elias\anaconda3\envs\test-service\lib\site-packages\TM1py\Services\SecurityService.py", line 26, in determine_actual_user_name
    return self.determine_actual_object_name(object_class="Users", object_name=user_name, **kwargs)
  File "c:\Users\elias\anaconda3\envs\test-service\lib\site-packages\TM1py\Services\ObjectService.py", line 46, in determine_actual_object_name
    response = self._rest.GET(url, **kwargs)
  File "c:\Users\elias\anaconda3\envs\test-service\lib\site-packages\TM1py\Services\RestService.py", line 696, in GET
    return self.request(
  File "c:\Users\elias\anaconda3\envs\test-service\lib\site-packages\TM1py\Services\RestService.py", line 297, in request
    response = self._execute_async_request(
  File "c:\Users\elias\anaconda3\envs\test-service\lib\site-packages\TM1py\Services\RestService.py", line 382, in _execute_async_request
    self.connect()
  File "c:\Users\elias\anaconda3\envs\test-service\lib\site-packages\TM1py\Services\RestService.py", line 524, in connect
    self._start_session(
  File "c:\Users\elias\anaconda3\envs\test-service\lib\site-packages\TM1py\Services\RestService.py", line 1016, in _start_session
    session_id = self._s.cookies.pop("TM1SessionId", None)
  File "c:\Users\elias\anaconda3\envs\test-service\lib\_collections_abc.py", line 904, in pop
    value = self[key]
  File "c:\Users\elias\anaconda3\envs\test-service\lib\site-packages\requests\cookies.py", line 334, in __getitem__
    return self._find_no_duplicates(name)
  File "c:\Users\elias\anaconda3\envs\test-service\lib\site-packages\requests\cookies.py", line 405, in _find_no_duplicates
    raise CookieConflictError(
requests.cookies.CookieConflictError: There are multiple cookies with name, 'TM1SessionId'

[svbtropical]

I guess it's not related to the specific branch, but to a change that was done between 2.0.3 and 2.2. Let me know if you want me to create a new ticket about this one.

Cheers!

[svbtropical]

Hi @MariusWirtz,

Nevermind about the above. I found the problem.

The datasets look good! I'm closing this case. Thanks!

Cheers,
Elías.