I am trying to insert data into a feature group that does not exist yet - here is the code:
import hopsworks
import pandas as pd
from hopsworks.project import Project
from hsfs.feature_group import FeatureGroup
from hsfs.feature_store import FeatureStore
project: Project = hopsworks.login()
fs: FeatureStore = project.get_feature_store()
fg: FeatureGroup = fs.get_or_create_feature_group(
name="test",
version=1,
primary_key=["col1"],
event_time="col2",
)
frame = pd.DataFrame({
"col1": ["hello", "world"],
"col2": [156746, 156886],
})
fg.insert(frame)
This is the error I get:
Connected. Call `.close()` to terminate connection gracefully.
Logged in to project, explore it here https://c.app.hopsworks.ai:443/p/4256
DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
Connected. Call `.close()` to terminate connection gracefully.
Traceback (most recent call last):
File "C:/Users/matfr/Documents/Projects/BillyBot/test.py", line 23, in <module>
fg.insert(frame)
File "C:\Users\matfr\miniconda3\envs\serverless-ml-2\lib\site-packages\hsfs\feature_group.py", line 1075, in insert
job, ge_report = self._feature_group_engine.insert(
File "C:\Users\matfr\miniconda3\envs\serverless-ml-2\lib\site-packages\hsfs\core\feature_group_engine.py", line 84, in insert
self._save_feature_group_metadata(
File "C:\Users\matfr\miniconda3\envs\serverless-ml-2\lib\site-packages\hsfs\core\feature_group_engine.py", line 391, in _save_feature_group_metadata
self._feature_group_api.save(feature_group)
File "C:\Users\matfr\miniconda3\envs\serverless-ml-2\lib\site-packages\hsfs\core\feature_group_api.py", line 49, in save
_client._send_request(
File "C:\Users\matfr\miniconda3\envs\serverless-ml-2\lib\site-packages\hsfs\decorators.py", line 35, in if_connected
return fn(inst, *args, **kwargs)
File "C:\Users\matfr\miniconda3\envs\serverless-ml-2\lib\site-packages\hsfs\client\base.py", line 171, in _send_request
raise exceptions.RestAPIError(url, response)
hsfs.client.exceptions.RestAPIError: Metadata operation error: (url: https://c.app.hopsworks.ai/hopsworks-api/api/project/4256/featurestores/4199/featuregroups). Server response:
HTTP code: 422, HTTP reason: UNPROCESSABLE_ENTITY, error code: 120001, error msg: An argument was not provided or it was malformed., user msg: Self-suppression not permitted
Process finished with exit code 1
I am using API_KEY with all but USER permission, my hopsworks version is 3.0.5 and python 3.8
Any ideas on what is happening?