Azure Machine Learning
An Azure machine learning service for building and deploying models.
3,340 questions
Not able to make data working in the Studio
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(60.8, 3%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EN%3C/text%3E%3C/svg%3E)
NAW123
16
Reputation points
Hi,
I am using Azure classic studio for ML. Reading large CSV files with 20 columns. One column has a Timestamp which becomes 2.01E+16 after I cleaned the data using Excel.
Each time I run it, it says:
[Information] In [<-.factor(*tmp*, ri, value = c(0L, 148L, 50L, 4L, 39L, 5L, :
[Information] invalid factor level, NA generated
[Stop] DllModuleMethod::Execute. Duration = 00:09:24.4753205
[Critical] Error: Error 0063: The following error occurred during evaluation of R script:
----------
Start of error message from R ----------
replacement has 1 row, data has 0
I used colSums to print it: colSums(is.na(test). It shows this column has 3 na VALUES in data and 2 in test.
I replace na with test[is.na(test$Timestamp),]$Timestamp<-"2.01E+16"
Still the same error.
It's so exhausting to test line by line with no way to debug it to pinpoint exactly where is the problem.
Plz help!
NWA
Azure Machine Learning
{count} votes
-
romungi-MSFT 48,911 Reputation points Microsoft Employee Moderator2022-07-08T07:59:42.013+00:00 @NAW123 Is it possible to pre-process the CSV dataset by using the apply math module before passing it your execute R script?
I would recommend trying the module with a small dataset and using the different settings to check if it can be converted back to a decimal. -
NAW123 16 Reputation points
2022-07-08T20:14:23.82+00:00 I applied it from "Statistical Functions", then Apply Math Operation, it says: Can not connect Zip to Dataset..., it won't connect to the modules' input.
How to apply it? How to assign decimal value? I tried <-0 for NA values, still the same error.
-
NAW123 16 Reputation points
2022-07-09T18:47:56.32+00:00 This colum is either 277 or 299, I want to replace NA with 0 or mean of the two values:
test[is.na(test$colum),]$colum<-285It's not working too, saying the same thing.
Should colum convert other type ? How to make text$colum numeric when replace values?
Do I need to convert data type when replace value for NA, if its categorical data, do I need to assign replacing value with ""?
-
romungi-MSFT 48,911 Reputation points Microsoft Employee Moderator
2022-07-12T07:46:29.713+00:00 You can replace values with mean if you use clean missing data component.
This component supports multiple types of operations for "cleaning" missing values, including:
Replacing missing values with a placeholder, mean, or other value
Completely removing rows and columns that have missing values
Inferring values based on statistical methods -
NAW123 16 Reputation points
2022-07-12T19:59:07.09+00:00 Cannot connect to it from zip file, where to put the cleaning missing data component?
Sign in to comment
Sign in to answer